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Description 

BACKGROUND OF THE INVENTION 
5 Field of the Invention: 

[0001] This invention relates to an Image processing method and apparatus for controlling input/output of a scan- 
ner/printer or the like, which is a combination of an image scanner and a printer. The invention relates also to an image 
processing system constructed using this apparatus. 

10 

Description of the Related Art: 

[0002] Networking has made great progress in recent years and large-scale networks in which a LAN is deployed 
throughout the entirety of an intelligent building are now being set up. Furthermore, nationwide networks which LAN's 
IS are connected directiy by public switched telephone networks and sophisticated information networks such as ISDN's 
are being established. 

[0003] These networks are making it possible for a user at one location to utilize a computer on anoUier floor or in 
anotiier building and enable a host computer in Osaka to be utilized from Tokyo. This in turn makes it possible for a 
printer server to be utilized over an extremely wide range rather tiian in tiie comparatively narrow range heretofore. 
20 [0004] In order for a printer to be shared as a common resource of a conventional network of the above-mentioned 
kind, the printer is connected to the network via a printer server. However, a scanner for reading in an image is not 
shared. 

[0005] in a situation in which inputs are made utilizing a scanner, all of the input data is handled as bitmap data. 

Consequentiy, if a scanner were to adopted as a common resource on a networK data that has been read would 
25 pass through tiie network and ttie amount of data involved would not only lower ttie efficiency of the network but wouki 

also necessitate a large storage area when the data is handled by a file server that is managing network files. Further, 

since the input data is handled as bitmap data, even a read original that is text cannot be edited as text. 

[0006] Accordingly, a problem encountered In ttie prior art is that even if a scannery)3rinter having a scanner and a 

printer is connected to a network, the scanner cannot be utilized effectively as a shared resource of the network unless 
30 the image data read in by the scanner is subjected to appropriate processing. 

[0007] A concern of the present invention is to provide an image processing system in whrch various Image 

processing services are used and a scanner/l^rinter can be utilised effectively. 

[0008] An article entitied "Color Descriptors in Page Description Languages" by Dvonch M.A. et al in the Proceed- 
ings of the Society for Information Display (USA). Vol. 30. No. 3. 1989. pages 177-181 desaik^es an electronic publish- 
35 ing system which discloses colour model implementation in page description languages. 

[0009] European Patent Specification Na EP-A-0067244 discloses a method for the automatic recognition of white 
t)locks as well as text, graphics and/or grey image areas on a printed master by means of successive searches for hor- 
izontal and vertical white t>locks in order to locate Vhite" frames for individual areas. 

[001 0] Japanese Patent Abstract No JP 4000864 discloses comprising processing efficiency of a picture transmit- 

40 ter by designating an input area by instructing compression or character recognition. 

[0011] European Patent Specification No EP-A-093299 discloses an apparatus and method of transmitting com- 
pressed data in which template matching of blocks of array data is used to reduce the amount of data transmitted. 
[001 2] None of these prior documents provides a solution to the problem set out hereinbefore. 
[0013] In accordance with a first aspect of the present invention there is provided an image processing apparatus 

45 as set out in claim 1 . 

[001 4] In accordance with a second aspect of the present invention tiiere is provided an image processing method 
as set out in claim 16. 

[001 5] Ottier features and advantages of the present invention will be apparent from tiie following description taken 
In conjunction with the acconpanying drawings, in which like reference characters designate the same or similar part 
50 throughout the figures thereof. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[001 6] The accompeinying drawings, which are incorporated in and constitute a part of the specification, illustrate 
55 emkxxfiments of the Inverrtion and. together with the description, serve to explain the principles of the invention. 

Rg. 1 is a diagram showing the configuration of a scanner/printer system emtxxjying tiie present invention; 
Rg. 2 is a diagram showing the intemal configuration of a scarmer/jprlnter server; 



2 



4 



EP 0 564 201 B1 

Fig. 3 is a diagram showing the configuration of a scanner/printer; 

Fig. 4 Is a block diagram showing the internal configuration of an image processing circuit on the scanner side; 
Fig. 5 is a block diagram showing the internal configuration of an image processing circuit on the printer side; 
Rg. 6 is a block diagram of a character recognition circuit; 
5 Fig. 7A is a diagram for describing character segmentation and Fig. 7B is a diagram tor describing feature extrac- 

tion; 

Fig. 8 Is a block diagram showing ADCT interpreter coding; 

Fig. 9 is a block diagram showing a circuit for a PDL Interpreter; 

Fig. 10 is a block diagram showing a translating circuit; 
10 Fig. 11 is a diagram showing VSYNC. HSYNC and raster scanning; 

Fig. 12 is a timing chart showing video l/F timing; 

Fig. 13 is diagram showing a transition in scanner status; 

Fig. 14 is diagram showing a transition in printer status; 

Fig. 15 is diagram showing a transition in error status; 
IS Figs. 1 6A to 1 61 are diagrams showing server command packets; 

Figs. 1 7A to 1 7H are diagrams showing scanner command packets; 

Rg. 18 is a diagram showing an altemate arrangement of a scannery|3rlnter; 

Rg. 19 Is a diagram showing the Internal oonflguratfon of a scanner/printer server in a second embodiment; 
Rg. 20 is a block diagram of a PDL converting circuit In the second embodiment; 
20 Rgs. 21 A and 21 B are diagrams showing server command packets in the second embodiment; 

Fig. 22 is a diagram showing an example of an image containing a mix of characters and images in the second 
embodiment; 

Figs. 23 A and 238 are diagrams for describing processing for thinning out an Image in the second embodiment; 
Figs. 24A and 24B are diagrams for describing processing through which an image Is partitioned into rectangles; 
25 Figs. 25A to 25F are diagrams showing examples in which areas are recognized in the second embodiment; 

Rg. 26 is a diagram useful in describing processing for recognizing the direction in which characters are arranged 
in the second embodiment; 

Rg. 27 is a diagram showing an example in which character data Is converted into page description language in 
the second emtxxliment; 

30 Rg. 28 is a diagram showing an example In which image data is converted into page description language In the 
second embodiment; 

Fig. 29 is a diagram showing an example in which graphic data is converted into page description language in the 
second embodiment; 

Fig. 30 is a flowchart of processing for converting an image into page description language in the second emtxxJi- 
35 ment; 

Rg. 31 is a flowchart of processing for converting an Image into page description language In the second embodi- 
ment; 

Rg. 32 is a flowchart of processing for converting an image into page description language In the second embodi- 
ment; 

40 Fig. 33 is a flowchart of processing for converting an Image into page description language in the second embodi- 
ment. 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 
45 [First Embodiment] 

[001 7] A network In which a copier Is connected as a scannerytsrinter will be described as a preferred embodlmertt 
of the invention. 

[0018] Figs. 1 and 2 illustrate part of a network according to a first embodiment of the invention; 

50 [0019] Fig. 1 is a diagram showing the configuration of a network system according to this emlxxiiment. The sys- 
tem includes a host computer 101 connected to a network (Ethernet) 104 and a copier 103 connected to the Ethernet 
104 via a scanner/printer server 102. The host computer 101 executes a client process 105 that is for controlling the 
copier 103. The scanner/printer server 102 executes a server process 106 that controls the copier 103 based upon con- 
trol of the dient process 105. The client processor 105 carries out communication with the server process 106 via the 

55 Ethernet 104. reads an Image from the scanner side of the copier 103 and prints out the Image on the printer side of 
the copier 103. Copying within the copier 103 also is possible. It goes without saying that the copier Is equipped with a 
scanner for reading images and a printer for printing out images. As will be described later, the scanner and printer can 
be utilized as Independent input/output devices. Further, solely the internally provided functions of the copier can be uti- 



3 



4 



EP 0 564 201 B1 

lized without employing the scanner and printer. 

[0020] Control signals and data signals exchanged by the scanner/{printer server 102 and copier 103 are SPCOM 
(a scanner^rlnter serial command signal) 107, CLOCK (a clock signal) 108, VSYNC (a vertical synchronizing signal) 
109. HSYNC (a horizontal synchronizing signal) 110 and DATA (an image data signal) 111. These signals shall be 
5 referred to collectively as video l/F signals. The copier 103 can be used as a scanner solely for reading in image data, 
as a printer for printing out image data that has been sent to it. as a copying machine for outputting, by means of the 
printer, an image that has been read in by the scanner, as a server without making inputs or outputs, etc. The type of 
use is decided based upon a oommand given by the SPCOM signal. The vkieo l/F signals are used in input/output of 
the image data and synchronizing signals. 

10 

( Configuration of scanner/l^rinter server (Fig. 2) > 

[0021 ] Rg. 2 is a diagram showing the internal configuration of the scanner/printer server 1 02. The various blocks 
will be described in accordance with Fig. 2. The scannery)3rinter server will be ak)breviated to "server" where appropri- 
15 ate. 

[Server-client communication] 

[0022] When the scanner/printer server 102 is started, a CPU 201 within the sender begins a program stored in a 
20 ROM 202 and executes the server process 106 using a RAM 203 as a temporary storage location. At this time the scan- 
ner/printer server 102 is connected to the Ethernet 104 via an Ethernet port 219 by means of an Ethernet controller 206 
so that communication Is possible with the client process 105 of the host computer 101 . 

[Server-copier communication] 

25 

[0023] The scanner/|3rinter server 102 and the copier 103 perform an exchange of data by means of the video l/F 
signals such as the CLOCK 108 and DATA 111. The exchange of data based upon the video l/F signals is started and 
is temporarily stopped in completely synchronous feshion. Alternatively, a change in parameters on the side of the cop- 
ier 103 is performed based upon the SPCOM (scanner/printer command) signal 107. 
30 [0024] A subordinate CPU 21 4 is a special-purpose CPU that constantly monitors the SPCOM signal 107 between 
the copier 103 and the server 102. The CPU 214 is in constant communication with the copier 103, performs block man- 
agement of the image data and accepts errors and the tike. 

[0025] A serial interface 215 allows serial communication of commands between the scanner/printer server 102 
and the copier 103 via a video l/F command port 221 . 
35 [0026] A video l/F signal control drcuit 216 is a circuit for controlling input/output of synchronizing signals, shown 
in Figs. 1 1 arxi 12, input of image data outputted from the scanner side in synchronism with this control, and output of 
image data sent to the printer side. The input/output signals controlled here are the video l/F signals described earlier. 
Input/output is performed via a video l/F data port 222. 

[0027] A dual-port RAM 208 performs communication between a main CPU 201 that manages the server process 
40 1 06 arKl the subordinate CPU 21 4 that manages interfacing with the copier 1 03. This is carried out by interrupt control 
in cooperation with a memory. Whereas the sutx)rdinate CPU 214 is in constant communication with the copier 103. the 
main CPU 201 applies an intenrupt to the subordinate CPU 214 only when necessary and delivers data through the 
dual-port RAM 208. Conversely, when the subordinate CPU 214 wishes to inform the main CPU 201 of end of scan and 
end of printing or of error information, the subordinate CPU 214 applies an interrupt to the main CPU 201 through the 
45 dual-port RMA 208 and performs an exchange of data. 

[0028] The scanner/printer server 102 sends a pre-scan command, a scan command and the like to the scanner 
side of the copier 103 as commands exchanged by the scanner/jsrinter server 1 02 and the copier 1 03. The scanner side 
of the copier 103 sends a copy command, status information, such as an information indicative of an operational abnor- 
mality, and the like. 

50 [0029] Similarly, the scanner/printer server 102 sends a print command arxJ the like to the printer side of the copier 
1 03. The printer side of the copier 1 03 transmits status information such an information indicative of lack of paper, paper 
jamming, operational abnormalities, etc. 

[Buffer memory] 

55 

[0030] The image data is accumulated in a buffer memory 209. which is capable of temporarily accumulating sev- 
eral lines of data. The buffer memory 209 is capable of being accessed from the CPU 201 . Character recognition, cod- 
ing and decoding of image data carried out upon reading the image data out of the buffer menrK>ry 209. 
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[Character recognition circuit] 

[0031 ] A character recognition circuit 2 1 0 executes processing for converting character-image data into character- 
code data. 

5 [0032] The conversion procedure performed by the circuit 210 is as follows: 
(1) Character cutting 

[0033] Character cutting is processing by which the CPU 201 detects breaks between pixels in the vertical and hor- 
10 izontal directions within the data stored in the buffer memory 209 and detects character segments. In actuality, the CPU 
201 subjects half-tone image data, which have been read by the copier 103, to threshold processing to determine 
whether or not a pixel is present. For example, in the case of character-image data "It's fine today", the character image 
is cut into the character segments "1", T, "s", T, "i", "n". "e". T. "o", "d". "a", V- IHhe case Is in Japanese. 

is cut into 

20 

"B"r 



25 

••BS"/ "5^"/ "4", 



30 

(2) Transfer of character segments 

[0034] The CPU 20 1 reads the image data of the character segments out of the buffer menrK>ry 209 and sends this 
data to the character recognition circuit 210. 

(3) Feature extraction of character segments 

[0035] An extracted character segment is further subdivided into smaller blocks, and in each block it is determined 
by detection whether contiguous pixels extend from side to side, up and down or diagonally. 

40 

(4) Calculation of degree of similarity 

[0036] Based upon the information indicative of feature extraction in each small t)lock obtained in feature extraction 
(3). a character whose features having the highest degree of similarity is extracted from a dictionary. A detailed block 
45 diagram is a shown in Fig. 6, described below. 

[0037] An Innage that has been read in subjected to character recognition by a procedure consisting of the four 
steps mentioned above. 

[Image coding/decoding circuit] 

50 

[0038] A coding/decoding circuit 21 1 codes the data that has been read in from the scanner of the copier 1 03. and 
decodes coded image data sent from the Ethernet 104. An example of the coding method is ADCT (adaptive discrete 
cosine transformation). The ADCT coding method is a coding method for still cotor pictures. This will be described later 
with reference to the block diagram of Fig. 8. 

55 

[PDL interpreter] 

[0039] A PDL interpreter 21 2 constitutes means for translating PDL (page description language), which describes 
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a print command regarding the printer, de/eloping the image In the txjffer memory 209 in the form of a bitmap or 
bytemap and printing the image by the printer of the copier 103. A blocl^ diagram of the PDL Interpreter 212 Is shown 
in Fig. 9, described below. 

5 [AutomatiG translating circuit] 

[0040] The characters converted into character codes by the character recognition circuit 210 are collected clause 
by clause to form one sentence. An automatic translating a'rcuit 213 accepts this sentence as data and translates it into 
a language designated by the host computer, for example, if the language read in from the scanner is Japanese, this is 
10 translated into English. 

[0041 ] The translation procedure consists of the following steps: 

(1) Morpheme analysis 

15 [0042] One sentence is divided into words. 

[0043] For example. " Watakushi wa kyo yujin no ie ni asobi ni iku 

so 

I will visit my friend today, In English" Is divided into 

"Watakushi 

« (it)", "wa (14)", 'kyo <^B)", "yujln "no (O) ", 

"ie "ni (tC)", "asobi (jtttf)", "ni (iC) " and "iku 

<ff<)". 

30 



(2) Modifier analysis 

35 

[0044] Modifiers are detected among the words resulting from morpheme analysis. 
[0045] For example, the word nxKlifying 

^ "ie (M)" 

is detected in the manner 

"yuJin CfeA)- ••no l<0) " "ie " . 



50 (3) Meaning analysis 

[0046] A check of suital»lity is performed based upon the context of the sentence. 
(4) Rephrase-rule analysis 

55 

[0047] When a translation is made from Japanese to English, word order is converted in accordance with the rules 
of the English language. In Japanese, the subject comes at the beginning of the senterKe or near the beginning, and 
the predicate comes at the end of the sentence. In English, however, the rules of word order are different from those of 
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the Japanese language. This conversion is made. 

[0048] For example, when " Watakushi wa kyo yujin no fe ni asobi ni iku 

I will visit my friend today, in English** is rearranged in English word order, we have 

"Watakushi wa ''asobi ni iku (MX/ 

tCtT<)" "yuJin no ie ni CfeAOSSC) " "kyo (#H)". 

If the rules are changed in the rule conversion, English can be translated into Japanese in a similar manner. A transla- 
15 tion between any two languages also is possble in similar fashion. 

(5) Translation 

[0049] A Japanese-English conversion. English-Japanese conversion, etc., is performed based upon the rephrase- 
20 rule. 

[0050] Any language can be translated into another through the procedure of five steps described above. 

[0051] Though there are configurations in which the automatic translating circuit 213 is provided in the server 102 

or in the host computer, the case illustrated here Is one in which the circuit 213 is provided in the server 102. 

25 [Hardware blocks] 

[0052] In order to realize the functions in the various blocks described above, or in order to realize functions not par- 
ticularly described in detail above, the server 102 has the following blocks: 

[0053] CPU 201 : Executes a server program stored in the ROM 202 to distritxjte image data, control the scan- 
30 ner/printer server 1 02 and manage the copier 1 03. 

[0054] ROM 202: The server program is stored here in advance. 

[0055] RAM 203: Used as the working memory of the CPU 201 and to temporarily store image data. 

[0056] Serial l/F 204: Used for making connection to a terminal or serial printer via a serial l/F port 217. 

[0057] Parallel l/F 205: Connected, via a parallel l/F port 218, to a parallel input/output scanner or printer consti- 

35 tuted by a Centronix l/F, GPIB. SIS, etc., to enable input/output of Image data via the parallel input/output port 218. 
[0058] Communication controller 207: Connects data, which is the result of converting character-image data into 
character-code data by means of character recognition, to a digital public switched telephone network or ISDN via a 
public switched telephone network i/F 220 and controls transmission or reception. Though there is a configuration in 
which the communication controller 207 is provided within the host computer, the controller 207 is provided in the server 

40 1 02 In the illustrated embodiment. 

< Configuration of copier (Rgs. 3, 4, 5)> 

[0059] Fig. 3 is a block diagram illustrating the copier 1 03. The copier 1 03 includes a CPU 306 that executes a pro- 
45 gram, which has been stored in a memory 305, to control each block constituting the copier. In this an^ngement, the 
operation of each component will be described for a case in which the scanner and the printer operate independentiy. 
In Fig. 3, a reading sensor 301 reads the image, and an image processing circuit 302 on the scanner side processes 
the image signal read by the sensor 301 . An image processing circuit 303 on the printer side processes image data out- 
putted by a printer engine 304. The printer engine 304 records the image data on a medium. A CPU 306 for controlling 
50 the scanner^rinter controls overall copier. A main memory 305 stores the program executed by the CPU 306. as well 
as various data. The blocks constructing ihe copier are interconnected by an image data bus 309 within the scan- 
ner/jprinter. The sensor 301 and the image processing circuit 302 shall be referred collectively as a scanner 310, and 
the printer engine 304 and image processing circuit 303 shall be referred collectively as a printer 31 1 . In a case where 
the scanner 310 or printer 31 1 is mentioned t)elow, this will be taken to include resources common to both, such as a 
55 CPU 306 and a timing control circuit 308. 
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[Scanner operation] 

[0060] Operation for a case in which an image is scanned will be described with reference to Fig. 3. 
[0061 ] A serial interface 307 receives a scan comnrtand from the scanner/printer server 1 02 and transmits the com- 
5 mand to the CPU 306. Next, the CPU 306 decides the image size to be read in, as well as the scanning starting position 
of the image, from the received scan command. 

[0062] The CPU 306 controls a scanner drive circuit (not shown) within the scanner 31 0, and the image is read out 
one pixel column at a time, as shown in Fig. 1 1 , by the sensor 301 . The read image data is subjected to the necessary 
image processing by the image processing circuit 302 on the scanner side. Thereafter, at the timing shown in Fig. 12, 
10 the timing control circuit 308 outputs CLOCK (dock signal) 1 08. VSYNC (vertical synchronizing signal) 1 09 and HSYNC 
(horizontal synchronizing signal) 110 as well as image data obtained from the image data bus 309. The image data is 
outputted as DATA (image data signal) 111 synchronized to these signals. The timing chart of Fig. 12 is an example rep- 
resenting the reading in of one page of data. 

[0063] The scanner/printer server 102 reads the image data in synchronism with the signals HSYNC 1 10, VSYNC 
15 109 and CLOCK 108 that enter from the copier 103. The video l/F control circuit 216 in the scanner^rinter server 102 
receives the image data from the copier 103 and stores it in the buffer memory 209. 

[Operation on printer side] 

20 [0064] Operation for a case in which an image is printed wilt be described with reference to Fig. 3. 

[0065] The serial interface 307 receives a print command from the scanner/jsrinter server 1 02 and transmits it to the 
CPU 306. The scanner/jprinter CPU 306 then decides the image side and the printing starting position of the image from 
the print command. 

[0066] The CPU 306 controls the printer engine 304 and records the image one pixel column at a time in the man- 
25 ner shown in Fig. 1 1 . At this time the timing control circuit 308 receives the synchronizing signals CLOCK 108, VSYNC 
1 09 and HSYNC 1 1 0. as well as the image data 111 synchronized to these signals, from the server 1 02 and the image 
processing circuit 303 on the printer side applies the necessary processing, after which the processing image data Is 
outputted by the printer engine 304. 

30 [Command operation] 

[0067] The serial interface 307 communicates commands between the server 102 and copier 103 by means of 
serial transmission using SPCOM (scanner/printer serial command signal) 1 07. A pre-scan command, scan command 
and the like are transmitted as data from the scanner/printer server 102 for the sake of the scanning function of the cop- 
35 ier 103. Further, the copier 103 transmits a copy command, status Information indicative of an operational abnormality, 
etc. 

[0068] Similarly, tiie scanneryj^rinter 102 transmits a print command and tiie like for the sake of the printer function 
of the copier 103. The copier 103 transmits status information Indicative of lack of paper, paper jamming, operational 
abnormalities, etc. 

40 

[Image processing on scanner side] 

[0069] Rg. 4 is a block diagram showing the image processing circuit 302 on tiie scanner side. The image process- 
ing circuit 302 in Rg. 4 includes a shading correcting unit 401. a resolution converter 402. a scanner color converter 
45 403, a scanner gamma converter 404 and a level converter 405. These units are connected to a bus (not shown). The 
parameters of tiiese units are capable of being changed from the CPU 306. 

[0070] The sensor 301 reads an RGB color image and inputs the resulting data to the image. processor 302 on the 
scanner skle. 

[0071] The entered image data is subjected to a shading correction in the image processor 302 by means of tiie 
50 shading correcting unit 401 . then the resolution converter 402 converts the reading resolution of the image. Resolution 
is capable of being selected from 400 dpi (dots per inch). 200 dpi, 1 00 dpi, etc. The resolution is designated by ttie CPU 
306. 

[0072] The scanner color converter 403 subjects the image to a color conversion. For example, the RGB color data 
Is converted to a color space such as YCrCb or to Lab. Of course, if tiie data merely passes through, the data remains 
55 the RGB color data. If reading Is nrronochromatic, a black-and-white conversion Is performed from tiie conrelation of the 
RGB data. The scanner color conversion is designated by the CPU 306. The scanner gamma converter 404 applies a 
gamma conversion, which is performed by an LUT (look-up table), to the image data, such as YCrCb, resulting from tiie 
color conversion. The designation of the LUT is canied out by the CPU 306. The level converter 405 converts the effec- 
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tive bit number of one pixel, for exanrple, the lower order bits of tlie YCrCb data, each item of which is composed of 
elglit bits, are discarded and a conversion of dynamic range is performed so that Y Is made six bits and Cr. Cb are made 
four bits each. The designation of the level Is made by the CPU 306. 

5 [Image processing on printer side] 

[0073] Fig. 5 is a block diagram showing the processing circuit 303 on the printer side. The image data that has 
entered the image processing circuit 303 is subjected to the processing described below. 

[0074] A printer color converter 501 color-converts the image to RGB. For example, if the image has entered In a 
10 YCrCb color space, then the image is converted to RGB. 

[0075] A printer gamma converter 502 subjects the input image to a gamma conversion. More specifically, the con- 
version performed is as follows: 



15 



20 



R'=f(R) 
G' = f(G) 
B' = f(B) 

This conversion is carried out by a LUT (look-up table). The setting of the LUT is performed by the CPU 306. 

[0076] A masking converter 503 subjects the input image to a masking conversion. The masking conversion is a 

primary conversion expressed by 



25 



(R"G"B") = a 
\ a 



11 

a2i 

^31 a32 




(Eq. 1) 



30 or a secondary conversion expressed by 



(R"G"B") 
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(Eq. 2) 



[0077] This conversion is performing using a LUT or gate array The parameters of the LUT or gate array are set by 
the CPU 306. 

[0078] A unit 504 for black generation and undercolor removal converts the RGB data into CMK, generates black 
55 (BIO from this data and performs undercolor removal. This is indicated as follows: 



C = 255-R" 



(Eq. 3) 
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M = 255-G" 
Y = 255 - B" 
Bk=a[min(C,YM)] 
C' = C-Bk 
M* » M - Bk 
r = Y-Bk 

This conversion is performed by a LUT or gate array. The parameters of the LUT or gate array are set by the CPU 306. 
[0079] A binarizer 505 binarizes the image if the printer engine 304 is a binary printer. The binarizing method can 
be charged over to any of three types, namely a simple binarizing method, a dither method or an en-or-diffusion 
method. If the printer engine 304 is a multivalued printer, the binarizer 505 is not required. The binarizing processing is 
performed by a gate array. The setting of the binarizing method, the threshold value for binarization. etc., is performed 
by the CPU 306. 

[0080] The foregoing is the construction of the copier 103. The elements constituting the scanner/printer server 1 02 
will now be described in greater detail. 

< Description of character recognition (Figs. 6, 7A and 7B) ) 

[0081] Rg. 6 is a block diagram showing the internal construction of the character recognition circuit, and Fig. 7A 
is a diagram for desaibing character segmentation which includes Japanese KANJI and KANA characters and the sen- 
tence means "It's fine today" In English. Rg. 7B is a diagram for describing feature extraction and the word means 
"book** in English. As shown in Rg. 6. the character recognition circuit includes a DSP (digital signal processor) 601 for 
control of character recognition, a dual-port RAM 602. a feature extracting circuit 603, an identification circuit (diction- 
ary) 604 and a local bus (for character recognition) 605. 

[0082] The procedure of character recognition is as described above in the section regarding the character recog- 
nition circuit. This will now be described in accordance with Figs. 6. 7A and 7B. 

[0083] As shown in Fig. 7A, character segmentation involves processing for detecting, horizontally and vertically, 
the spacing between characters in the character image data that has been stored in the buffer memory 209, and seg- 
menting the character blocks. A segmented character block is written in the dual-port RAM 602 from the CPU 201 . The 
DSP 601 reads out the image data of the character block and inputs the data to the feature extracting circuit 603. As 
shown in Fig. 7B, the feature extracting circuit 603 subdivides the character Image data into smaller blocks, detects tiie 
directions of lines in the blocks and extracts the features of the characters. Rg. 7B illustrates nine blocks enclosed by 
ovals. In actuality, however, subdivision is made into even smaller blocks, e.g.. 64 blocks or more. 
[0084] The results of feature extraction are sent to the identification circuit 604. where characters similar to the 
extracted features are selected. At this time several similar characters are selected and all of the character codes are 
written in the dual-port RAM 602. Based upon the context of the characters, the main CPU 201 detects the relevant 
characters from the characters that are candidates. This erKis the character recognition procedure. 

[Image coding/decoding (Fig. 8)] 

[0085] Rg. 8 is a diagram illustrating functional blocks within the image coding/decoding circuit 211. This circuitry 
performs ADCT coding and compresses the RGB multivalued image (each color consisting of eight bits). 
[0086] In the ADCT method, the R. G, B signals enter from an R (red) component input unit 801 , a G (green) com- 
ponent input unit 802 and a B (blue) component input unit 803, whereupon these conponents are converted into Y, Cr, 
Cb (luminance and chrominance components) by a color converter 804. The converted signals are applied to a Y (lumi- 
nance) component input unit 805, a Cr (chrominance) component input unit 806 and a Cb (chrominance) component 
input unit 807. where the respective components are extracted. The component signals from tiie units 805, 806, 807 
enter an 8 x 8 DCT (discrete cosine transformation) processor 808. The DCT processor 808 subjects each signal to a 
two-dimensional discrete cosine transformation every 8x8 block. 

[0087] The signal resulting from DCT Is separated into AC and DC components after the DCT coefficients are lin- 
early quantized by a linear quantizer 809. The AC components are subjected to zigzag scanning by a zigzag- 
scan/image-data input unit 812, after which the resulting signal is subjected to two-dimensional Huffman coding by a 
two-dimensional Huffman coder 813. The DC components undergo a one-dimensional prediction in a one-dimensional 
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predicting unit 810. after which the output of the predicting unit 810 is Huffman-coded by a Huffman coder 81 1 . The two 
code quantities are multiplexed by a multiplexer 814 to obtain a compressed image. 

[0088] Data can be decompressed by subjecting it to processing which is the result of that executed by the ADCT 
coding block diagram of Fig. 8, namely expanding the data starting from the side of the multiplexer 814. 
5 [0089] The color converter 804 converts the RGB data into YCrCb. If a function of the kind implemented by the 
scanner color converter 403 shown in Fig. 4 is provided in the scanner, the color converter 804 will be unnecessary. 
TTiough Fig. 8 is a method of coding/decoding multivalued color image data, other methods are conceivable. For exam- 
ple. MH, HR, MMR or LZW (Lempel-Ziv & Welch) methods used in fecsimile communication can be enrployed. 

10 ( PDL Interpreter (Fig. 9) ) 

[0090] Fig. 9 is a block diagram of circuitry for realizing a PDL interpreter. 

[0091] PDL (page description language) is sent from the host computer 101 to the scanner/^>rinter server 102 
through the network. In the server 102. PDL temporarily accumulated in the RAM 203 through the Ethernet controller 
75 206 is read out and interpreted by the PDL interpreter 212 and developed as an image. A CPU 901 in the PDL inter- 
preter is the circuit for this purpose. A RAM 902 is a working memory used as this time, and a ROM 903 stores a pro- 
gram executed by the CPU 901 . 

[0092] The result of developing one bit by the CPU 901 is written in the buffer memory 209 through the main CPU 
bus 223. This is subsequentiy sent to the printer of the copier 103 as image data and is printed out by the copier 103. 

20 

< Description of automatic translation (Fig. 10)> 

[0093] Fig. 10 is a block diagram of circuitry for realizing tiie automatic translating circuit 213 that performs Japa- 
nese-English/English-Japanese translation. 

25 [0094] Characters that have been put into the form of character codes are collected togetiier clause by clause and 
written in a dual-port RAM 1007 connected to the main CPU bus 223 and to a local bus 1008 so as to be accessible 
from both buses. A CPU 1001 on the side of the translating circuit 213 reads out a clause and subjects it to morpheme 
analysis. The words of each phrase are analyzed based upon words registered in a word-dictionary ROM 1004. Next, 
after modifier analysis is performed, meaning analysis is carried out. At this time also analysis is performed t)ased upon 

30 the dictionary in the ROM 1004. The reordering of the words in a sentence is carried out by the rephrase-rule analysis 
based upon a rephrase-rule dictionary 1005. After word order of the sentence has been changed, a translation from 
Japanese to English or from English to Japanese is carried out based upon an English^apanese/Japanese-Engllsh 
dictionary 1006. the ti-anslation is written in the dual-port RAM and is read out to the main CPU 201. In order for the 
foregoing processing to be Implemented, a program executed by the CPU 1001 is stored in a ROM 1003. A RAM 1002 

35 is a memory used at this time. 

(Operation of scanner/jsnnter) 

[0095] The operation of the scanner/printer server for character recognition of this embodiment constructed as set 
40 forth above will now be described. In this descrq3tion. the arrows indicate a sequential operation. 

[Scanner] 

(1) Pre-scanning 

45 

[0096] 

-> Read-in by the client process 1 05 on the side of the host computer is designated. 

The designation is received by the server process 1 08 on the side of the scanner/|3rinter server. 
50 An image is read in from the scanner 310 of tiie copier 1 03. 

-> The server 102 buffers the image data, which has been read in, in the buffer memory 209. 

-> Data that has been subjected to thinning-out processing or compression processing is transferred to the host com- 
puter 101 through the network 104. 

The client process 105 on the side of the host computer causes a monitor (not shown) to display data obtained by 
55 decompressing the thinned-out data or compressed image data. 

[0097] The image read in by the copier 103 tiirough the foregoing operation is received by the host computer 101 . 
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(2) Character-recognition scanning 
[0098] 

The image data obtained by the pre-scanning (1 ) undergoes character-area designation and reading in of the 

image from the dient process 105 is designated again. 
-> Reading in is designated by the server process 106 on the side of the scannery^rinter server. 
-> The designated area is read in by the scanner 310 of the copier 103. 
-> The server 102 buffers the read image data in the buffer menrK>ry 209. 

The character areas of the buffered image data are subjected to character segmentation. 

Cheiracter coding is performed by the character recognition circuit 210. 

The character codes are accumulated in the RAM 203. 
-> The character codes are transfenred to the host computer 1 01 through the network 1 04. 

[0099] By performing the foregoing operation, an image is read in by the copier 103. characters are recognized and 
the results are received by the host 101 . 

[0100] The processing described below can be added to the character-recognition scanning operation set forth 
above. 

O When characters are segmented from the buffered image data, character color or background color is detected, 
characters of a designated color or of a color other than that designated are recognized, the characters are coded 
and the codes are transfened to the host computer. 

® By segmenting a character from the buffered character image, character position is detected, this is added on 
to the character code and the result is transferred to the host computer 101. 

By segmenting a character from the buffered character image, character position is detected, the character 
code and position information obtained are converted into the form of page description language and the result is 
transferred to the host computer 101 . 

O The type of font and the size of a character code resulting from character recognition are detected, after which 
the type of font and size are changed by a designation made in advance from the host computer 1 01 . 
& The character image read in is held in the server 102 in the form of page description language, tiiis is combined 
with image data (a natural scene or the like) obtained by scanning the image data again and tiie result is transf en-ed 
to tfie host computer 101. 

® The character image read in is held in the server 102 in the form of page description language, this is combined 
with image data, which is obtained by scanning the image data again, after tiiis image data is compressed, and the 
result is transferred to the host computer 101 . 

[0101 ] The foregoing operations also can be carried out. The printer of the copier 103 performs the following oper- 
ations: 

[Printer] 

(3) Printing 
[0102] 

-> Print data is transferred to the server 1 02 from the client process 1 05 on the side of the host computer. 

The print data is received by the server process 1 06 on the side of the scanneryjarinter server. 
-> If the print data is in tiie form of page description language, bit devek)pment is performed by the PDL interpreter 

212. 

[0103] If the print data is compressed image data, bit development is performed by the coding/decoding circuit 21 1 
[0104] If tiie print data is character-code data, character bit development is performed. 
[0105] If tiie print data is bit data, this is not subjected to any processing. 

-> The bit data is accumulated in the buffer memory 209 of the serv^ 1 02. 

The data in the buffer memory 209 is sent to the copier 103 and the data is printed by the printer 311. 

[0106] In a case where tiie client uses the apparatus as a character recognition server by employing tiie character 
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recognition function within the scanner/printer server 102. the following operations are perfornrted: 

(4) Character recognition server 
10107] 

The character image data Is transferred to the server 1 02 from the client process 1 05 on the side of the host con> 
puter. 

-> The character image data Is received by the server process 1 06 on the side of the scanner/printer server. 

-> If the character image data Is compressed Image data, bit development is earned out by the coding/decoding circuit 

211 . If the character image data is bit data, the data is not subjected to any processing. 
-> The character image data is stored temporarily in the buffer memory 209. 
-> The kxjffered character image data is subjected to character segmentation. 
-> Coding of the character image data is performed by the character recognition circuit 210. 
-> The character code is accumulated in the RAM 203. 

-> The character code is transferred to the host computer 101 again through the network 104. 

[01 08] By virtue of the foregoing operations, the apparatus functions as a character recognition server for process- 
ing the data provided by the host computer 101 and retuming the processed data to the host. 
[01 09] The following procedure can be added as an operation of the character recognition server: 

O When characters are segmented from the buffered image data, character color or background color is detected, 
characters of a designated color or of a color other than that designated are recognized, the characters are coded 
and the codes are transferred to the host computer. 

@By cutting a character from the buffered character image, character position is detected, this is added on to the 
character code and the result Is transferred to the host computer 101. 

® By cutting a character from the buffered character image, character position is detected, the character code and 
position information obtained are converted into the form of page description language and the result is transferred 
to the host computer 101. 

[01 10] In a case where the copier 1 03 is used as character recognition copy by employing the character recognition 
function within the scanner/printer server 102, the following operations are performed: 

(5) Character recognition copy 
[0111] 

->• The character original is read from the scanner 310. 

The server 102 buffers the image data in the buffer memory 209. 

Coding of the buffered character image is carried out by the character recognition circuit 210. The type of font and 

size are identified at the same time. 
-> The character code, font category arxi size are accumulated in the RAM 203. 

-> The font and size of the character code are changed to those designated by the host computer 101 in advance. 

Bit development of the character-code data is carried out. 
->• The bit data is accumulated in the buffer memory 209 of the server 1 02. 

The data In the buffer memory 209 is sent to the printer 31 1 of the copier 103 and is printed out 

[Oil 2] The following operations are performed when the apparatus is used as a character-recognition/automatic- 
translation server for automatically translating character strings and sentences that have been put Into the form of char- 
acter codes by character recognition: 

(6) Character-recognition/automatic-translation server 
[0113] 

-> The image data obtained by the pre-scanning (1) undergoes character-area designation and read-In of the image 

to the server 102 from the clierrt process 105 is designated again. 
-> The designation Is received by the server process 106 on the side of the scanner^rinter server. 
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The designated area is read in by the scanner 310 of the copier 103. 

The server 1 02 buffers the image data in the buffer memory 209. 

The buffered character image data is subjected to character segmentation. 
-> Character coding is performed by the character recognition circuit 210. 
5 The character codes are accumulated in the RAM 203. 

-> The character codes are transfenred to the host computer 101 through the network 104. 

-> The client processor 105 receives the character codes and performs automatic translation based upon the charac- 
ter strings and sentences befbre and after. 

10 [0114] A translation can be performed between any two languages. For example. English can be translated into 
Japanese or Japanese can be translated into English. 

[0115] The foregoing is an example in which automatic translation is performed by the host computer. However, 
there is also a case in which translation is performed utilizing the translation function that employs the automatic trans- 
lating circuit 213. after which the translated character codes are sent to the host computer 101 through the network 1 04. 
15 [0116] Described next will be operation in a case where the apparatus is used as a character recognition/teletext 
communication server for sending or receiving a document, which has been subjected to character recognition and 
converted into character codes, using a put>lic switched telephone network. 

(7) Character-reoognrtlon/teletext communication Server 

20 

O Transmission 
[0117] 

25 -> The image data obtained by the pre-scanning (1) undergoes character-area designation and read-in of the image 
to the server 102 from the client process 105 is designated again. 

The designation Is received by the server process 1 06 on the side of the scanner/k^rinter server. 
-> TTie designated area is read In by the scanner 310 of the copier 1 03. 

The server 102 buffers the image data in the buffer memory 209. 
30 The buffered character image data is subjected to character segmentation. 

-> Coding of the character image data is performed by the character recognition circuit 21 0. 

The character codes are accumulated in the RAf^ 203. 

The character codes are transferred to the host computer 101 through the network 104. 
-> The client processor 105 receives the character codes and transfers the codes to the other party through a public 
35 switched telephone network, such as a digital public switched telephone network or ISDN, that is connected to the 
host computer 101. 

® Reception 

40 [0118] 

-> Data transferred from the sender is received by the host computer 101. and the host computer 101 transfers this 

data to the scanner/printer server 102 through the network 104. 
-> The data is received by the server process 106 on the side of the scanner/jDrinter server. 
45 If the received data is in the form of page description language, bit development is performed by the PDL interpreter 

212. 

[0119] If the data Is compressed image data, bit development is performed by the image coding/decoding circuit 
211. 

50 [0120] If the print data is character-code data, character bit development is performed. 
[0121 ] If the print data is bit data, this is not subjected to any processing. 

-> The bit data is accumulated in the buffer memory 209 of the server 1 02. 

The data in the buffer memory 209 is sent to the copier 1 03 and the data is printed by the printer 311. 

55 

[0122] The sending/receiving operation described above Illustrates an exanple in which the function of the puk)lic 
switched telephone network is performed by the host conrputer. However, there are also cases in which a connection Is 
made to the piSokic switched telephone network using the communication controller 207. whk;h performs a public 
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switched telephone network connecting function, within the server 102, and character codes that have been converted 
from the character image data are sent to the other party via the put)lic switched telephone network. Conversely, it is 
possible for the server 1 02 to receive data, wNch has been transferred from a public switched telephone network by the 
communication controller 207. and print out this data from the printer 311 of the copier 103. 

5 

< Description of innage input/output procedure) 



[0123] Image input/output of the scanner/printer server 102 of this embodiment will be described with reference to 
a zigzag chart while referring also to messages exchanged . 

10 [0124] In a case where the image Is read in from the copier 103. it is necessary to designate various parameters, 
for example, it is necessary to designate the size of the image, the position of the image, resolution, format (dot sequen- 
tial scanning, line sequential scanning, field sequential scanning), edge emphasis, color space (RGB. YCrCb). color 
[which color to send (such as Q only) is designated], level (number of tones of a color), coding method (ADCT. no cod- 
ing, etc.), bit rate (bit rate at time of coding), thinning-out ratio at the time of pre-scanning, the file into which data is to 

15 be read, character recognition setting (whether or not to perform recognition, color designation and conversion to page 
description language, etc.)- 

[0125] Accordingly, the client processor 105 instructs the user, via a user internee such as a display, to designate 
these parameters. The user responds by designating the parameters and instructing the host computer 101 to execute 
pre-scanning. When this is done, the client process 105 communicates with the server process 106 in accordance with 
20 the sequence shown in Fig. 13. 

[0126] Before Fig. 1 3 is described, the commands exchanged between processes and commands to the copier will 
be discussed with reference to Figs. 16A to 161 and 17A to 17H. 
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< Packet configuration (Figs. 1 6A to 1 61 and 1 7A to 1 7H) > 



[0127] The configuration of packets exchanged by the host computer 101 and scanner/)3rinter server 102 will be 
desaibed with reference to these drawings. It should be noted that the description focuses on what appears in a zigzag 
chart described below. 

[0128] Rg. 16A to 161 are diagrams showing packet configuration. Each field constituting the packet will be 
30 described. 

[0129] Fig. ISA shows a PRESCAN packet, Rg. 16B a SCAN packet and Fig. 16C a PRINT packet. The first byte 
of each packet is a tag representing what the packet is. for example, if the packet is PRESCAN. pre-scanning is indi- 
cated by "1". If the packet Is SCAN, scanning is indicated by "2". 
[0130] XSIZE indicates the size, in the X direction, of an image comprising two bytes. 
35 [0131] YSIZE indicates the size, in the Y direction, of an image comprising two bytes. 

[0132] XSTART indicates scanning and printing starting position, in tiie X direction, of an image comprising two 
bytes. 

[0133] YSTART indicates scanning and printing starting position, in tiie Y direction, of an Image comprising two 
bytes. 

40 [0134] XZOOM indicates scanning and printing resolution, in the X direction, of an image comprising one byte. 
[0135] YZOOM indicates scanning and printing resolution, in the Y direction, of an image comprising one byte. 
[0136] FORMAT indicates the image scanning method, in which "1" designates dot sequential scanning, line 
sequential scanning and "3" fieki sequential scanning. 

[0137] EDGE/SMOOTH indicates the degree of edge emphasis and smoothing, in which 16-1 designates edge 

45 emphasis and -1 ~ -1 6 designates smooUiing. 

[01 38] COLORTYPE indicates tiie color space of an image, in which '*1 ** is designated for RGB, for GM Y. "3" for 
CMYK. "4" for YCeCb, "5" Lab and "6" for XYZ. In case of RGB. a first color shall refer to R. a second color to G and 
third color to B. In case of YCrCb, a first color shall refer to Y, a second color to Cr and a third color to Cb. 
[0139] COLOR indicates which color of the image colors is to be transmitted. The particular color is assigned by bit. 

50 for example, if a color is the first color, the 0th bit is made "1 if a color is tiie second color, the 1s7 bit is made "1 if a 
color is the tiiird color, the 2nd bit is made "1"; if a color is the fourth color, the 3rd bit is made T. 
[0140] By way of example, if COLORTYPE is RGB and all colors of RGB are sent we have 7 (= 000001 1 1 B). It 
should be noted tiiat "B" attached to a numeral indicates that the number is a binary number. 
[0141] In a case where the two colors R. B are sent, we have 5 (first color = 1 , third color = 4: 00000101 B). Similarly. 

55 in a case where COLORTYPE is YCrCb and only Y is sent we have T. 

[0142] LEVEL conprises two bytes. The first four bits indicate the number of tones of the first color, the next four 
bits indicate the number of tones of the second color, and the next four bits indicate the number of tones of the third 
color. The final four bits are not defined. 
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[0143] The number of tones represented by these bits is designated by an exponent of 2. such as 256 tones in case 
of 8 and four tones in case of 6. 

[0144] CODE indicates the coding method. Here "O" is designated if there is no coding. T in case of coding by 
ADCT, "2" in case of MMR and "3" in case of LZW. 
5 [0145] BITRATE indicates the coding ratio of coding, in which "S" indicates a compression ratio of 1/6 and "12" a 
compression ratio of 1/12. 

[0146] XSTER YSTEP designate how much of an image is to be thinned out and sent at the time of pre-scanning. 
for example, in a case where an image is sent every five pixels vertically and horizontally, we have XSTEP = 5, YSTEP 
= 5. If the image Is not thinned out, XSTEP = 0 and YSTEP = 0 hold. 

10 [0147] OCR Indicates whether character recognition is to be carried out or not. When character recognition is 
applied to data in an area that undergoes scanning, "1" Is set; if character recognition is not executed. "0" is set. Further. 
"2" is set in a case where position information is added on to the character recognition function; "3" is set in a case 
where data is converted into page description language; and "4" is set if a character of a designated color is detected 
and only this character is subjected to character recognition. The character of the color designated by COLOR is then 

IS recognized. Further, "5" is set if only an area of a background color whose color has been designated is subjected to 
character recognition. A character written in a different color in an area whose color has been designated by COLOR Is 
recognized. Other values are options that allow the relationship between color and characters to be expanded. 
[0148] The foregoing is a description of each field of the PRESCAN packet and SCAN packet. Each field of the 
PRINT packet will now be described, although a description of portions identical with those in the above-mentioned 

20 packets will be omitted. 

[0149] UCR 1 78 indicates a at the time of black generation [see Eq. (3)]. 

[0150] BI-LEVEL 179 indicates a binarization method, in which "0" indicates tiiat binarization is not performed in a 
case where the printer engine 304 is a multivalued printer, further, "1" indicates fattening pattern in the ditfier method, 
"2" a BAYER pattern in the dither method, "3" a simple binarization method, and "4" an en-or calculation method. 
25 [01 51 ] THRESHOLD 1 80 indicates a binarization threshold value (0 ~ 255) in the simple binarization metiiod. 
[0152] PAGE 181 indicates the number of pages at the time of printing. 
[0153] Rg. 16D illustrates an OK packet. This packet is merely an OK tag of one byte. 

[0154] Rg. 16E illustrates a GAMMA packet, in which S/P182 of a second byte indicates whether to set the gamma 

table of the Image processing circuit 302 for the scanner or the image processing circuit 303 for the printer in the copier 
30 103. From this point onward, the gamma table is composed of 768 bytes of three colors each consisting of 256 bytes. 

[01 55] Rg. 1 6F illustrates a MASKING packet constitijted by a masking tag and masking parameters aij conoprising 

a fixed decimal point of two bytes. Here aij represents the component of a matrix situated at row i and column j. 

[0156] Rg. 16G illustrates a STATUS packet constituted by a status tag, a number N183 of the states, and STA- 

TUSn (n = 0 ~ N) indicating status. 
35 [0157] Rg. 16H illustrates a DATA packet constituted by a data tag, a number N of Items of image data that follow 

the data tag, and items of image 1,2,3***. 

[01 58] Rg. 1 61 Illustrates an ESC packet, in which the first byte is a sequence that starts at ESC. An Image Is devel- 
oped into a bitmap or bytemap by the interpreter 212. This is equivalent to the ESC sequence of an ordinary printer. 

40 [Constitution of commands] 

[0159] Commands exchanged by the server 102 and copier 103, such as a pre-scan command, scan command, 
status information, gamma setting command and masking setting command are communicated in format the same as 
that shown in Fig. 16A to 161. 

45 [0160] Rg. 17A to 17H Illustrate the constitution of conrvnands exchanged by the server 102 arKi the copier 103. 
Rg. 1 7A shows the pre-scan command, Rg. 1 78 the scan command and Rg. 1 7C the print command. The first byte of 
each packet is a tag that indicates what the packet Is. For example, if the packet is the PRESCAN packet, the tag is **1 
which indicates pre-scanning. In case of the SCAN packet, the tag is "2", which indicates scanning. 
[0161] Each field of the packets in the pre-scan, scan and print packets will now be described. 

50 [0162] XSIZE, YSIZE indicate, by two bytes, the size of an image in the X and Y directions, respectively. 

[0163] XSTART, YSTART indicate, by two bytes, scanning and printing starting position of an Image in the X direc- 
tion and scanning and printing starting position of an image in tiie Y direction. 

[0164] XZOOM, YZOOM indicate, by one byte, scanning and printing resolution of an image in tiie X and Y direc- 
tions, respectively 

55 [0165] FORMAT Indicates the image scanning method, in which "1" designates dot sequerrtial scanning, "2" line 
sequential scanning and f leM sequential scanning. 

[0166] EDGE indicates the degree of edge enphasis and smootiiing. In which 16-1 designates edge emphasis 
and -1 ~ -16 designates smoothing. 
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[0167] COLORTYPE indicates the color space of an image, in which "1 " is designated for RGB, for CMY, "3" for 
CMYK, "4" for YCeCb. "5" Lab and "6" for XYZ. In case of RGB, a first color shall refer to R, a second color to G and 
third color to B. In case of YCrCb. a first color shall refer to Y, a second color to Cr and a third color to Cb. 
[0168] COLOR indicates which color of the image colors is to be transmitted. The particular color is assigned by bit. 
5 for example, if a color is the first color, the 0th bit is made "1 if a color is the second color, the 1st bit is made "1"; if a 
color is the third color, the 2nd bit is made "1 ": if a color is the fourth color, the 3rd bit is made T. 
[0169] By way of example, if COLORTYPE is RGB and all colors of RGB are sent, the 0th. 1st and 2nd bits are 
made "1 " so that we have "7" (= 000001 1 1 ). 

[01 70] In a case where the two colors R. B are sent, similarly we have "S" (first color = 1 , third color « 4: 00000 101). 

10 Similarly, in a case where COLORTYPE is YCrCb and only Y is sent, we have "1 ". 

[0171] LEVEL comprises two bytes. The first four bits indicate the number of tones of the first color, the next four 
bits indicate the number of tones of the second color, and the next four bits indicate the number of tones of the third 
color. The final four bits are not defined. The value of a LEVEL field designates, by an exponent of 2, the number of 
tones of each color, such as 256 tones in case of 8 and four tones in case of 6. 

IS [0172] CODE indicates the coding method. Here "0" is designated if there is no coding, "1" in case of coding by 
ADCT, "2" in case of MMR and "3" in case of LZW. 

[0173] CODE indicates the coding method. Here "0** is designated if there is no coding and "1" in case of coding by 
ADCT 

[0174] UCR indicates a at the time of black generation [see Eq. (3)]. 

20 [0175] BI-LEVEL indicates a binarization method, in which "0" indicates that binarization is not performed in a case 
where the printer engine 606 is a multivalued printer. Further, "1" indicates a fattening pattern in the dither method, "2" 
a BAYER pattern in the dither method, "3" a simple binarization method, and "4" an error diffusion method. 
[0176] THRESHOLD indicates a binarization threshold value (0 - 255) in the simple binarization method. 
[0177] PAGE 1 81 indicates the number of pages at the time of printing. 

25 [0178] Fig. 17D, which is one type of status information, illustrates OK. This is an OK tag of one byte. 

[0179] Rg. 17E illustrates a gamma setting command. Here S/P of a second byte indicates whether to set the 
gamma table of the image processing circuit 302 for the scanner or the image processing circuit 303 for the printer in 
the copier 103. From this point onward, the gamma table is composed of 768 bytes of three colors each consisting of 
256 bytes. 

30 [0180] Fig. 1 7F illustrates a MASKING packet constituted by a masking tag and masking parameters comprising a 
fixed decimal point of two bytes. The content of the command has a meaning identical with that of Fig. 16F 
[0181] Fig. 17G illusti-ates status information constituted by a statijs tag, a number N of the states, and N-number 
of states (STATUS 1 ~ N) indicating status. 

[0182] Fig. 17H is a copy command. This is merely a copy tag of one byte. 
35 [0183] A command sequence for using the copier 1 03 from the client process 1 05 will now be desaibed. 

< Description of command sequence (Figs. 13 ~ 15)> 

[Scanner side] 

40 

[0184] As shown in Rg. 13. first the client process 105 sends the server process 106 (arrow 131) a PRESCAN 
packet PI comprising ttie XSIZE. YSIZE, XSTART. YSTART XSTEP. YSTEP of the imaga XSI2E, YSIZE, etc.. are 
parameters that designate the size, etc.. of an image that is to be read in. 

[0185] In order to perform coding of the image and thinning-out at the time of pre-scanning of the image, the coding 
45 method as well as the bit rate and thinning-out ratio at the time of coding are set in the server process 106 when the 
PRESCAN packet PI is received. All other information is sent from the serial interface 215 to the copier 103 as a pre- 
scan command (arrow 132). 

[0186] In accordance with the information of the pre-scan command, tiie copier 103 sets the parameters in the 
image processing circuit 302 on the scanner side. If these parameters have been set correctiy. an "OK" response is sent 

50 back to the server process 106 (arrow 133). When the server process 106 receives the "OK" response from the copier 
103. it sends an OK packet P4 back to the client process 105 (an^ow 134). If the parameters have not been set correctiy, 
status information is sent back to the server process 106 instead of "OK". When the copier 103 receives the pre-scan 
command, it reads out the image one line at a time. At the time of pre-scanning. the video-interface control circuit 216 
of the scanner/printer server 102 raises the output timing signals HSYNC 1 10, VSYNC 109. CLOCK 108 and DATA 1 1 1 

55 to a high impedance, and the server 102 reads in data from DATA 111 (arrow 135), and writes it in the buffer memory 
209, in synchronism with the input timing signals HSYNC 110, VSYNC 109 and CLOCK 108 generated by the copier 
103. 

[0187] At this time, tiie image is thinned out in accordance witii tiie thinning-out ratio of XSTEP. YSTEP com- 
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manded by the PRESCAN packet PI » the image data is split into a suitakMe size or joined and a plurality of DATA packets 
P2 comprising a DATA tag. the number off bytes of the packet and the image data are constructed. These are sent to 
the client process 105 of the host computer 101 (arrow 136). 

[0188] In the dient process 1 05 of the host computer 1 01 . the thinned-out data is extracted from the image packet 
5 P2 received from the server process 1 06 and the data is displayed on a CRT (not shown). If all of the image data has 
been sent normally, the copier 103 sends "OK" from the serial interface 307 to the server process 106 (arrow 137). 
When "OK" is received from the copier 103. the server process 106 sends the OK packet P4 to the client process 105 
(arrow 138). 

[0189] When the OK packet P4 Is sent to the client process 105. the server process 106 waits for the next command 
10 packet from the client process 105. The client process 105 receives all of the thinned-out image data, displays it on the 
CRT and asks the user which area of the image is actually to be read. 

[0190] In response, the user employs a pointing device such as mouse to designate which area is actually to be 
scanned. The user designates also whether the designated area or color character Is to be subjected to character rec- 
ognition. The start of scanning is indicated to the client process 105. 
IS [01 91 ] When this is done, the client process 1 05 sends the server process 1 06 (anrow 1 39) a SCAN packet P3 com- 
prising the XSIZE. YSIZE. XSTART YSTART of the image. 

[01 92] When the SCAN packet P3 is received in the server process 1 06. "OK" is sent back to the client process 1 05 
(arrow 1310). through a procedure similar to that of PRESCAN. if this information has been set con^ectly. 
[0193] The sender process 106 reads in the image from the copier 103 again in accordance parameters that have 
20 been designated by the SCAN packet (arrow 1311). 

[01 94] In a case where an ordinary image has k>een read in. the image data is split into an appropriate size or joined 
and a plurality of DATA packets comprising a DATA tag, the number of bytes of the packet and the image data are con- 
structed. TTiese are sent to the client process 105 of the host computer 1 01 . 

[0195] In the client process 105 of the host computer 101, the image data is extracted from the image packet P2 

25 received from the server process 1 06 and the data is written in successively. 

[0196] If all of the image data has been sent normally, the server process 106 serKis the OK packet P4 to the client 
process 105 (arrow 1313). When the OK packet is sent to the client process 106. the server process 106 waits for the 
next command packet from the client process 105. When the OK packet is received from the server process 106, the 
client process 105 waits for the next command from the user. 

30 [0197] In a case where the destination of character code information is a transfer to another party on the public 
switched telephone network owing to an irxjication from the host computer 101 , there are two transfer paths. In a case 
where the server 102 has a communication controller, a direct transfer is made from the server 102 to the public 
switched telephone network. If the host computer 101 has a communication controller, data is transferred from the 
server 1 02 to the host 1 01 and the client process 105 receives the data and transfers it on the public switched telephone 

35 network. 

[Printer side] 

[0198] Fig. 14 is a diagram for describing the printing operation. The exchange of data among the client process 
40 1 05 of the host computer 1 01 , the scanner/printer server 102 and the copier 103 at the time of printing will be described 

in accordance with Fig. 14. 

[0199] Rrst, in the host computer 101 , the user designates the names of files in the host computer 101 holding the 
size of tile image to be printed, the position of the image to be printed and the image to be printed. As for parameters 
for gamma conversion and masking conversion, etc.. at the time of printing, default values usually are set However, 
45 these can be changed. 

[0200] In this case, in Fig. 14, first the dient process 105 sends a GAMMA packet P6 to the server process 106 
(anrow 141) In order to set a gamma table for gamma conversion at the time of image printing. If the gamma table has 
already been set, it is unnecessary to send this packet. If the GAMMA packet P6 is received, in the server process 1 06, 
a gamma-tal)le setting command is sent, via the video 1/F, to the printer side of the copier 103 if the second byte of tiie 

50 GAMMA packet indicates the printer and to the scanner side if the second byte indicates the scanner (arrow 142). In 
this case, tiie printer of the copier 103 is used and therefore the gamma conversion table is set on the printer side. 
[0201] The copier 103 sets the LUT of the printer gamma converter 502 in accordance with the parameters of the 
gamma setting command, if the LUT can be set normally. "OK" is sent back to tiie server process 106 (arrow 143). 
When "OK" is received from the copier 103. the server process 106 sends back the OK packet P4 to the client process 

55 105 (arrow 144). 

[0202] Next, the client process 105 sends a MASKING packet P7 to the server process 106 in order to set the 
masking table at the time of image printing. If the masking table has already been set it is unnecessary to send the 
packet If the MASKING packet P7 has been received in the server process 106. the masking setting command is sent 
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to the copier 103 (arrow 146). The copier 103 sets the parameters in the masking converter 503 within the image 
processing circuit 303 on the printer side in accordance with the parameters of the masking setting command, ff the 
parameters have been set normally. "OIC is sent t>ack to the server process 106 (arrow 147). When "OK" is received 
from the scanner, the server process 1 06 sends the OK packet P4 back to the client process 105 (arrow 148). 
5 [0203] When setting of the parameters for gamma conversion and masking conversion is completed in the manner 
described above, the client process 1 05 sends the server process 106 a PRINT packet P8 comprising XSIZE, YSIZE. 
XSTART. YSTART, PAGE, etc., of the image (arrow 149). 

[0204] When the PRINT packet P8 is received in the server process 106, the PRINT command is sent from the 
serial interlace 21 5 to the copier 1 03 (arrow 1410). When the copier 1 03 receives the information of the print command 

10 correctly and sets the parameters, the copier sends "OK" back to the server process 106 (arrow 141 1). When "OK" is 
received from the scanner, the server process 1 06 sends the OK packet P4 k>ack to the client process 1 05 (arrow 1412). 
[0205] When "OK" is received in the client process 1 05, the image is read out of the designated file. The client proc- 
ess 105 splits the image data that has been read into an appropriate size or joins the data to construct a plurality of 
DATA packets P9 comprising a DATA tag, the number of bytes of the packet and the image data. These are sent to the 

IS server process 106 (arrow 1413). In the server process 106. the image data is extracted by the image packet P9 
received from the client process 105 of the host computer 101 and the print data is sent successively to the copier 103 
via the video l/F (arrow 1414). 

[0206] At the time of printing, the video l/F control circuit 2 1 6 of the scanner/printer server 1 02 outputs the group of 
synchronizing signals HSYNC 110, VSYNC 1 09 and CLOCK 1 08. as well as the image data synchronized to these sig- 
20 nals, to DATA 111. and the copier 1 03 reads the data that is to be printed from DATA 1 1 1 in synchronism with the group 
of synchronizing signals and prints out this data. 

[0207] If the entire image is printed correctly, the copier 103 sends "OK" from the serial interface 307 to the server 
102 (arrow 1415). When "OK" is received from the copier 103, the server process 1 06 sends the OK packet to the client 
process 105 (arrow 1416). When the OK packet is sent to the client process 105, the server process 106 waits for the 
25 next command packet from the client. The client process 105 starts waKing for the next command from the user at the 
moment the OK packet is received from the server process 106. 

[0208] In the print operation described above, a case is described in which the image data is sent from the host 
computer 101 in response to an instruction from the client process. However, there are also cases in which the scan- 
ner/printer 102 reads in the image data from the scanner of the copier 103. makes a conversion into page description 
30 language and changes the type, size or color of the character and then performs printing. Similarly, there are cases in 
which a character code or the like is accepted from a public switched telephone network, bit development is performed 
within the scanner/l^rinter server 102 and printing Is performed. 

[Enor] 

35 

[0209] Fig. 1 5 is a diagram for describing a case in which an en-or is generated at the time of printing. Exchange of 
data among the host computer 101 . scanner/idrinter server 102 and printer 103 at the time of printing will be described 
with reference to Fig. 15. 

[021 0] As in the case of printing described above, the client process 1 05 sets the gamma table and masking table 

40 at the time of image printing. Next, tiie client process 1 05 sends the server process 106 tiie PRINT packet P8 compris- 
ing XSIZE, YSIZE. XSTART YSTART, PAGE. etc.. of tiie Image. When the PRINT packet P8 Is received in the server 
process 106, the PRINT command is sent from the serial interface 215 to the copier 103 (arrows 151 - 1510). 
[0211] If ttie values of the parameters of tiie print command are improper, or in the occurrence of an abnormality, 
such as an Inability to set the values, or an en^or such as tack of paper, tiie copier 103 sends status information, which 

45 indicates the error status, back to the server process 1 06 (arrow 1511). 

[021 2] When the server process 1 06 receives the status infbrmatk>n from the copier 1 03, it converts the status infor- 
mation Into a STATUS packet P10 and sends this packet t>ack to the client process 105 (arrow 1512). 
[0213] When the client process 105 receives the STATUS packet P10. it outputs an appropriate message to tiie 
user in accordance with the status to inform the user of the fact that an error has occurred. If an error such as paper 

50 jamming has occurred during printing, the CPU 306 of the copier 103 Immediately suspends the printing operation and 
transmits the status information of the error from the serial interface 307 to the server process 106. 
[021 4] When the status information from the printer side 1 03 is received In tiie server process 1 06. the status infor- 
mation is sent to tiie client process 105 as a STATUS packet P10 and the next command is awaited. 
[0215] When the STATUS packet P10 is received, the client process 105 outputs an appropriate message to tiie 

55 user in accordance witii the status to inform the user of the fact tiiat an error has occurred. 
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[Character recognition server] 

[0216] There is also a case In which the character recognition means and automatic translating means wHhin the 
scanner/jDrinter server 102 are used from the host computer 101. In this case, character image data of a desired area 

5 is clipped in advance on the side of the host computer 101 , and the client process 105 sends the character image data 
to the server process 106. Processing similar to that for the case in which the image is read in by the copier 103 is exe- 
cuted within the sender 102. and a character code is sent to the host computer 101 through the network 104. In this 
case, the copier 103 does not take part in processing, a message sent from the host 101 to the server 102 Is processed 
by the server 102 and a command to undergo processing is not delivered to the copier 103. 

10 [021 7] If a copier that Is constructed and functions in the atKsve-described manner and Its server system are used, 
the following effects are obtained: 

(1) The copier can be combined with a scanner/printer server, which is capable of performing character recognition, 
and can used as a common resource in a network. In other words, the network user is capable of sharing the server 

15 function as well as the copier. 

(2) A character-image original is read from the scanner and a character code is obtained. As a result, the amount 
of data is reduced and the load upon the network diminished, thereby raising the processing speed of the computer 
and improving operability. 

(3) The character-image original read in by the scanner can be converted Into page description language automat- 
20 ically. 

(4) A colored character-image original can be read in and characters of a designated color can be extracted from 
the original. 

(5) The type and size of characters in the character-image original that has been read in can be changed and then 
printed. 

25 (6) The character-image that has been read in can be subjected to character recognition, converted into character 
codes and translated automatically. 

(7) The host computer in the network is capat>le of utilizing only the character recognition function of the server. 

(8) A character-image original is subjected to character recognition and can either be sent to a public switched tel- 
ephone network or received as a character code and then printed. 

30 (9) An image read in by the scanner is converted into PDL, thereby making it possible to reduce the image data. 
The memory required for the image data can k>e reduced and the time required for transfening the image data can 
be shortened. 

[021 8] In this embodiment, a case is desaibed in which the kjus-type network 1 04 is used as the network. However, 
35 the network may be of any type, for example, an FDDI employing a token ring or optical fibers is capable of being used 
as the network means. 

[0219] Further, In this emtxxiiment a case is described in which serial comnrunication Is used In order to commu- 
nicate data such as commands, parameters and eaors between the scanner/printer 102 and the copier 103. However, 
the invention is not limited to serial communication. Any two-way communication internee can be employed. 

40 [0220] In this embodiment, serial communication is used to communicate data such as commands, parameters and 
errors between the scanner/printer 102 and the copter 103, and a video irrterface is used to communicate image data. 
However, the invention is not limited to these communication irrterfaces. Information such as commands, parameters 
and errors and image data can be communicated on the same communication line using an interface, such as an SCSI 
or GPIB, tiiat is capable of two-way communication. 

45 [0221] In tills embodiment, an image is sent upon being coded by the ADCT coding method in a case where tiie 
image has a dot-sequential YCrCb format. However, tiie invention Is not limited to ADCT coding and any coding method 
can be used. As a result, coding can be applied to an image other than those having the dot-sequential YCrCb fonnat, 
and the image can be compressed and transmitted. 

[0222] The buffer memory 209, which is for se/eral lines, is used in the server 102. However, a memory for one 
50 screen can be provided so that speed can be raised even further. 

[0223] In this emlxxJiment, the scanner 31 0 of the copier 103 transmits the image upon thinning it out at the time 
of pre-scanning but does not thin out the image at the time of main scanning. However, in a case where a color image 
is pre-scanned. tiie following can be combined: 

55 (1) transmission solely of single-color components: 

(2) thinning out arxi transmission; 

(3) coding and transmission; 

(4) reduction of number of tones and transmission; and 
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(5) reduction of image resolution and transnnission. 

[0224] In this embodiment, the sensor 301 performs scanning three times in a case where the image is read In, 
scanned, converted and transferred. However, it is possible to read an image only one time, store the image data in a 
5 hard disk, read out the image from the hard disk three times and then perform scanning. As a result, mechanically scan- 
ning need be performed only once and speed can be raised. 

[0225] Further, it is possible to perform scanning and conversion of a first color at the same time as the data is 
stored in the hard disK with the remaining two colors t^ing read out of the hard disk. 

[0226] In this embodiment, an image is binarized by the binarizer 505 since the printer engine is a binary printer 
10 engine. However, a multivalued image can be dealt with In the same manner. TTiis can be accomplished with ease by 
providing an N-value unit in case of an N-valued printer engine. 

[0227] The present invention can be applied to a system constituted by a plurality of devices or to an apparatus 
comprising a single device. Furthermore, it goes without saying that the invention is applicable also to a case where the 
object of the invention is attained by supplying a program to a system or apparatus. 
IS [0228] Further, the copier and the scanner/printer server can be unified. Fig. 18 is a diagram showing an an-ange- 
ment in which the copier and scanner/printer server are combined. Though the functions provided are the same as in 
the foregoing embodiment, a copier 181 in Fig. 18 is such that the scanner/printer server 102 is built in the copier 103 
of Fig. 1 . The copier 181 performs the function of the server 102. 

[0229] Though a copier has been described in the foregoing embodiment the invention is not limited to a copier but 
20 can be applied to any apparatus, such as a facsimile machine, that has a scanner. 

[Second Embodiment] 

[0230] A system will now be described in which, instead of the PDL interpreter circuit 212. there is provided a PDL 
25 converter circuit, which converts a read image into PDL in order to reduce the amount of image data read in from the 
copier of the first embodiment. 

[0231 ] In this embodiment, the construction of the scanner/printer server 1 02 is made different from that of the f irst 
embodiment. The environment of the server 102 has the arrangement of Fig. 1 or Fig. 18 of the first embodiment. 
[0232] Rg. 19 is a block diagram showing the configuration of the scanner/printer server according to the second 
30 embodiment. Since the configuration is substantially the same as that shown in Rg. 2. only the difference between the 
two will be described. Specifically, Fig. 19 differs from Fig. 2 in that the PDL interpreter 212 is eliminated while a PDL 
converter circuit 227, a hard disk (HD) 226 and a disk interface 225 are provided anew. 

[Hard disk] 

35 

[0233] The hard disk (HD) 226 is used in order to temporarily store print data (code and image data) sent from the 
network. By temporarily storing the print data in the HD226. the print data obtained by being transfenred via the network 
can be received while it is being printed, thereby making it possible to execute processing that does not apply a load to 
the network. At the time of scanner processing, the image data that has been read in from the scanner of the copier 103 

40 is accumulated in the buffer memory 209. This data is stored in the HD 226 after it is subjected to processing for area 
discrimination. When the image data is converted into page description language by the PDL converter circuit 227, the 
image data that has been stored in the HD 226 is read out and processed (the conversion of the image data to page 
description language will be described later). Consequently, scanning of the image data need not be performed again. 
Of course, in a case where the image data is required again, the image data stored in the HD 226 is capable of being 

45 utilized. It shouki be noted that the HD 226 is connected to other blocks via a DISK l/F 225. The DISK l/F 225 manages 
irput/output of the data of the HD 226. 

[PDL converter circuit] 

so [0234] The PDL converter circuit 227 converts an image, which has been developed in the buffer memory 209 as 
a bitmap or bytemap, into PDL that describes a print command to the printer. Rg. 20 is a block diagram of the PDL con- 
verter 227. 

[0235] Rg. 20 is a partial circuit block diagram of the PDL converter 227 for converting the image data read in from 
the scanner into data described in PDL 
55 [0236] The image data is read In from the scanner of the copier 103 and accumulated temporarily in the buffer 
memory 209. A CPU 2001 analyzes the input image data, discriminates the type of image contained in the data and 
classifies the areas according to type. The categories are character, graphic and image, and each area and the posi- 
tional information are recognized. Processing proceeds while the data obtained during the course of this area discrim- 
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inating processing, such as data indicative of labeling or the like, is being saved temporarily in a RAI^ 2002. Using the 
inforniation obtained by area discrimination, the CPU 2001 recognizes a character from the image data by the character 
recognition means, codes the character portion, combines it with other information and converts it into page description 
language. Image and graphic areas are combined with the position data of tiie image data and converted into page 
description language. The character recognition means may be provided within the PDL converter circuit and have a 
construction similar to that described in connection with the character recognition circuit 210. Alternatively, the charac- 
ter recognition circuit 210 may be utilized if desired. 

[0237] The foregoing processing is illustiBted in the flowcharts of Figs. 30 through 33. The control program of these 
flowcharts is stored in a ROM 2003 and is executed under the corrtrol of the CPU 2001 . 

[0238] The processing of Rg. 30 can be divided roughly into four stages. These are initial setting processing (steps 
S2501. S2502). processing for discriminating areas of image information (steps S2503 - S2509). processing for dis- 
criminating detailed information contained in the image information (steps S2510 ~ S2518) and processing for convert- 
ing an image into data described in PDL (steps S2519 ~ S2521). 
[0239] Each step in Fig. 20 will be described in detail. 

[0240] At step S2501 . a command indicating the type of PDL is inputted from the host computer 101 to the server 
102 via the network 104. In subsequent processing, the image information is described in the PDL of the type desig- 
nated at this time. Next, at step S2502. selection of a program conforming to the type of PDL is performed in order to 
extract information, which is suited to the PDL of the type designated, from the Image information. 
[0241 ] Fig. 27 illustrates an example of two types of PDL, namely CaPSL and PostScript. Fig. 27 shows an example 
of character and separator images using tine character strings in the left column. 

[0242] The following three items of information are required to convert a character portion into page description lan- 
guage: 

1. starting-position information; 

2. font information (character size, character pitch and character style); and 

3. character-code information. 

[0243] The character area of an image has its position and size discriminated by the area discriminating means. A 
character code is recognized by the character recognition means. The area discriminating means will be described 
later. Character size and character pitch are known from the character width and character pitch discriminated by the 
area discriminating means. Though character style (type of font) is capable of being recognized if the character recog- 
nition means is provided with a function for judging the features of characters, here style will be fixed to a predetermined 
style in order to simplify the apparatus. If the accepted information is in a PDL format on tiie side of the host computer, 
the character style can be changed in a simple manner. Consequently, major problems do not arise even if a character 
is fixed to a specific style. 

[0244] The following three items of information are required in order to convert the separator portion into page 
description language: 

1 . starting-position information; 

2. line information and line-starting information; and 

3. line-end information. 

[0245] Rg. 28 illustrates an example of image data indicative of a natural scene or the like. In case of a natural 
scene, the image data is saved as a bitmap or in compressed form. Therefore, tiie following three items of information 
are required in order to convert the natural scene into page description language: 

1 . starting-position information; 

2. raster-image paint information (total number of bytes, width, height, resolution and compression format of the 
image area); and 

3. image data. 

[0246] The starting-position information is recognized by the area discriminating means. Since the resolution des- 
ignated by the host computer at the time the scanning command Is issued Is received as a command, the resolution 
can be obtained by holding this command in advance. Width and height are obtained from the coordinate values of the 
rectangle surrounding the image data discriminated by the area discriminating means. The total number of bytes is 
found from width, height and resolution, further, a command that designates the image coding method enters from the 
host computer when the scanning command is issued, and image compression is carried out in ttie designated format 
using the image coding drcuit within the server 202. Consequently, by holding this designating command in advance. 



22 



EP0 564 201 B1 



the compression format is obtained. 

[0247] Rg. 29 illustrates an example of a graphic image. The area described by this graphic can be determined if 
the pixel density within the rectangle recognized as the image area is investigated. However, though recognizing a 
graphic and coding it is possible with regard to a simple graphic, great difficulty is encountered with regard to an image 
5 composed of a line drawing or the like. Accordingly, a graphic area is handled as image data in the same manner as an 
area which is a natural scene. In such case, the following three Items of infornnation are required in order to convert a 
graphic portion into page description language: 

1. starting-position information: 
10 2. raster-image paint information (total number of bytes, width, height, resolution and compression format of ttie 
image area); and 
3. image data. 

[0248] These items of data are obtained by a method similar to that used for the natural scene described earlier. 
15 [0249] Thus, the data needed for PDL conversion differs depending upon the nature of the image, and conversion 
Is made into codes that differ depending upon the type of PDL, as illustrated in Figs. 27, 28 and 29. Accordingly, in order 
to convert image data Into the PDL designated at step S2501 . processing Is executed in accordance with the program 
conforming to the designated PDL. 

[0250] With reference again to Fig. 30. step S2503 is executed if the initializing processing has ended. At step 
20 S2503. the image information to undergo the PDL conversion designated from the host computer 101 enters from tiie 
scanner of the copier 1 03. The entered data is accumulated in the buffer memory 209 of the server 1 02 at step S2504, 
and the area discriminating processing, which is the pre-processing of character recognition and PDL conversion, starts 
under the control of tiie CPU 2001 . The above-mentioned image discriminating means is realized by image discriminat- 
ing processing executed by the CPU 2001. 
25 [0251 ] The area discriminating processing Is executed witti regard to an original, read in from tiie scanner, which is 
likely to contain characters, graphics or a natural scene. When character recognition processing and conversion to PDL 
are performed after area discriminating processing, the image data to undergo processing is required again. Accord- 
ingly, tiie following metiiods are conceivable as metiiods of securing the image data that will be necessary after area 
discrimination. 

30 

1) The capacity of ihe buffer memory 209 is made large enough to accumulate one page of data. 

2) The buffer memory 209 is employed as a band memory and a magnetic disk or the like capable of temporary 
storage is provided witiiin the server 202. 

3) The buffer memory 209 is employed as a band memory, and image input for area discrimination and image input 
35 after area discrimination are each performed by scanning the original. 

[0252] Though any of these metiiod is acceptable, in tiiis embodiment tiie server is provided with the HD 226 and 
method 2) is adopted. The following description is premised upon the fact tiiat tiie server 202 possesses means for re* 
obtaining image data that is to undergo discrimination after area discrimination. 
40 [0253] Rg. 22 is an example of an image original containing characters and a natural scene. As shown in Rg. 22, 
the character portion is partitioned into several sections. It will be assumed that the image of Fig. 22 is to undergo 
processing subsequentiy. and that tiie image has been stored in tiie buffer memory 209 after being read in from tiie 
scanner. 

[0254] At step S2502 in Fig. 30, the image data that has been stored in the buffer memory 209 is compressed by 
45 being thinned out using an m*n matrix. In thinning-out processing, if the m*n matrix has data for wNch even one dot 
exceeds a predetermined threshold value, the dot information corresponding to this matrix is made "1 ", as shown in Fig. 
23A. If the m^n matrix does not have data which exceeds a predetermined threshoki value, the dot information corre- 
sponding to tills matrix is represented by ''O", as shown in Fig. 23B. The data otitained by this tiiinning-out processing 
is saved in a work area of the RAM 203. 
50 [0255] The tiiinning-out processing is means for speeding up area discrimination. Discrimination of the features of 
the image information can be carried out sufficierrtly even with thinned-out information. 

[0256] Labeling processing is executed at step S2506. In labeling processing, image information obtained by thin- 
ning-out processing is subjected to a search. That is. "1" pixels (referred to as "black pixels" hereinafter) are searched 
line by line and a label is attached thereto. Pixels that are contiguous vertically, horizontally or diagonally are assigned 
55 the same label, and pixels are grouped by enclosing groups of contiguous pixels In rectangles. TTie labels referred to 
here are for discriminating contiguous pixels. In tiie labeling processing, pixels are replaced by characters or character 
strings, such as A. B, C. 

[0257] The labeling processing procedure will be described witti reference to Rgs. 24A and B. Image Information 
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exempirfied by Fig. 24A has a black pixel at the third pixel from the left on the first line. Accordingly, the label "A" is 
attached to the third pixel. White-pixel portions are made "0". Though the fifth pixel is a black pixel, the fourth pixel is a 
white pixel and therefore the third and fifth black pixels are not contiguous. Accordingly, a label "6". which Is different 
from that of the third pixel, is attached to the fifth pixel. The eighth through tenth pixels on the first line are contiguous 

5 black pixels but these are not connected to "B" of the fifth pixel. Accordingly, each of these contiguous k)lack pixels is 
assigned a label "C". Next, the second line is searched. Since the third pixel on the second line is a t^lack pixel and the 
pixel contiguous to this black pixel from above ft has already been assigned the label "A", this black pixel also is 
assigned the same label "A". Since the fourth pixel has the black pixel A neighboring it on the left, this pixel also is 
assigned the label "A". Accordingly, though the fifth pixel on the first tine was labeled "B". this pixel is diagonally contig- 

to uous to the fourth pixel on the second line and therefore the label of the fifth pixel on the first line is changed to "A". 
[0258] By repeating the same processing, the Innages of Fig. 24A can be labeled by the labels A and B, as shown 
in Rg. 24B. 

[0259] When labeling processing has concluded, rectangle forming processing is executed at step S2507. In this 
processing, contiguous pixels are enclosed by a rectangular frame. To this end, maximum vertical and horizontal cir- 
15 cumscrlbing lines of each label are stored in advance. The maximum circumscribing lines are determined by the max- 
imum and minimum value of coordinates (x,y) of pixels to which the same label has been assigned. The area that 
contains contiguous black pixels thus becomes a rectangle having one label assigned thereto. The data that has been 
labeled is saved in the work area of the RAM 203 at step S2508. 

[0260] The above-descrflded thinning-out processing and lat>ellng processing are executed whenever image data 
20 enters the buffer menfx>ry 209. Processing is repeated until it is determined at step 82509 that the entire image has 
been processed. 

[0261 ] After labeling processing (step S2506) and rectangle forming processing (step S2507), rectangle-size infor- 
mation such as the width W, height H. area S and pixel density D is extracted from the extracted rectangle information 
and the attributes of the rectangle, such as character, graphic, natural scene, table or separator, which separates the 
25 end of a paragraph by a frame or line in a sentence, are discriminated at a step S251 0. 

[0262] The criteria for judging the rectangle size information for the purpose of discriminating each of these 
attributes will be desaibed. 

[0263] If rectangles in which characters are present are contiguous with widths W and heights H of a predetermined 
size and there is a moderate amount of blank space in the rectangles, as shown in Figs. 25A and 25B. these rectangles 
30 are judged as being character areas. 

[0264] If a rectangle in which a graphic is present has a size in excess of a certain level and the pixel density D 
within tine enclosed area is less than a fixed value, as shown in Fig. 25C. this rectangle is judged as being a natural- 
scene area. 

[0265] As shown in Fig. 25E, a rectangle in which a separator is present may have a widtii W or height H in excess 
3S of a fixed length (this is a continuous separator, such as a straight line). In another example, rectangles may have a 
width W and height H of a fixed length and be contiguous (a discontinuous separator such as a dashed line), or a rec- 
tangle may have a width W and height H In excess of a certain size, in which the inner skie and outer side have the 
same circumscribing lines (as in the case of an enclosure). These rectangles are judged as being separator areas. 
[0266] A rectangle in which a table is present, as shown in Fig. 25F. is judged based upon the following criteria: 
40 Specifically, if a rectangle has a size in excess of a predetermined size, the pixel density within the enclosed area is less 
than a fixed value (i.e., the interior of the area has a blank space) and the area is partitioned by lines such as a sepa- 
rator, this rectangle is judged as being a table area. 

[0267] The attrilxrte information of an image judged in the manner described above is saved in tiie RAM 203 along 
witii the rectangle information. 

45 [0268] When the attribute information of all rectangles in the input image has been judged at step 82510, more 
detailed judgment of features is performed for each and every attritxite. 

[0269] To this end, information of a rectangle saved in the RAM 203 as a separator Is read out at st^ 8251 1 , line 
thickness and line type (solid or broken) is decided based upon the rectangle size information, this is coded and tiie 
codes are saved in ttie RAM 203. Furttier. the information of tiie rectangle saved in the RAM 203 as a table is read out. 
50 and information indicative of the position and thickness of the frame forming the table is coded. Character areas within 
the table are registered in the RAM 203 anew as character rectangles, character recognition is performed by a charac- 
ter recognition function described below, and coding is then earned out. 

[0270] The rectangle information that has been saved in the RAM 203 as a natural scene or graphic is read out at 
step S2512 and the information indicative of position and frame is coded. Since processing for recognizing a graphic 
55 and coding it is fairly complicated, this processing is not carried out. although the attribute information of a graphic area 
differs from tiie attribute information of natural scene, the graphic image data is handled as a bitmap in the same man- 
ner as a natural scene. In a case where compression processing is performed, processing suited to the type of image 
data is applied. 



24 



EP 0564 201 B1 

[0271] At step S2513. the information of a rectangle saved in the RAM 203 as a character area Is read out. a his- 
togram of black pixels is calculated at several locations in each of the vertical and horizontal directions, and the charac- 
teristics thereof are analyzed (i.e., subjected to projective analysis). Rg. 26 illustrates the histogram. At step S2514, It 
is decided, based upon the dispersion of the amount of black pixels and the spacing of the wfiite pixels, whether the 

5 character string in these rectangular areas has been written vertically or horizontally. 

[0272] Next, at step S251 5. the average of the height H and width W of the character rectangle information read out 
is obtained in accordance with the typesetting direction determined at step S2514. and character width Is decided. 
[0273] This is followed by step S251 6, at which the spacing between rectangles Is obtained from the character rec- 
tangle information read out, and character pitch Is analyzed. 

10 [0274] Next, a character not in corribrmity with the character widths determined by step S251 6 is judged at step 
S251 7 to be a header character tsased upon these character widths. The area of a header character also Is subjected 
to analysis of rectangle height H and width W, character size and pitch, and this area is coded accordingly. 
[0275] This is followed by step S2518. at which the code information obtained by analysis at steps S251 1 ~ S251 7 
is saved in the RAM 203 along with the attribute information. 

IS [0276] When the information analysis of every rectangle performed by the area discriminating means ends, the 
image data is read In again successively from the initial position at step S251 9 and tine data is accumulated in the buffer 
memory 209 again at step S2520. Theresifter, processing for converting the image data, which has been accumulated 
in the buffer memory 209. into PDL starts from step S2521 . 

[0277] At step S2521 , one band of the image that has been accumulated in tiie buffer memory 209. as well as tine 
20 image attribute data and position data of tiie image tiiat has been saved in the RAM 203. is converted into the PDL des- 
ignated at step S2501 . The detailed procedure of the processing executed at step S2521 Is illustrated in the flowcharts 
of Figs. 32 - 33, each of which will now be described. 

[0278] The flowchart of Fig. 32 represents processing for ordinary character portions as well as for character por- 
tions within a table. 

25 [0279] It is determined at step S2601 whetiier the image data accumulated in the buffer memory 209 at step S2520 
contains an ordinary character portion or a character portion within a table. This determination is made in accoidance 
with the attribute information and rectangle position Information saved in the RAM 203. In a case where tiie image con- 
tains a character, processing for this character portion or for a character portion in a table is continued. If the image 
does not contain a character, the program branches to symtx)t E in Fig. 33 so tiiat a transition is made to processing for 

30 a natural scene and graphic. 

[0280] If a character portion is present in the buffer, it is determined at step S2602 whether the entire character por- 
tion fits in the buffer memory 209. This determination is made based upon the position information in RAM 203. 
[0281] If the answer at step S2602 is "NO", then the program branches to step S2606, at which joint processing is 
executed. Next, it is determined at step S2607 whether the joint is at the upper portion. If the answer is "NO", then the 

35 program branches to step S2609, at which the Joint-Image data is saved in the RAM 203. 

[0282] If it Is determined that the joint Is at the upper portion, then the joint-Image data of the band of the upper por- 
tion already saved in the RAM 203 Is added on to tiie image data, whk^h has been accumulated in the buffer memory, 
at step S2608. after which the program branches to step S2603. 

[0283] If it Is determined tiiat the character portion accumulated in tiie buffer memory 209 fits in the memory, or if 
40 the adding on of tiie joint data at step S2608 is finished, then the character contained in the image data is recognized 
by the character recognition circuit 210 and the character is converted into a character code at step S2603. The pro- 
gram then proceeds to step S2604, at which tiie rectangle position information, for which there is character information, 
that is obtained from the recognition discriminating processing and saved in the RAM 203 is re-saved in the RAM 203 
together with character code obtained. 
45 [0284] The foregoing processing is repeated while a check is performed to determine whether the processing of tiie 
character area in the buffer memory 209 has ended. 

[0285] The flowchart of Rg. 33 is processing for natural-scene portions and graphic portions. 

[0286] It is determined at step S2701 whetiier tiie image data accumulated in tiie buffer memory 209 at step S2520 

contains a natural-scene portion or a graphic portion. This determination is made in accordance with the attribute infor- 

50 mation and rectangle position information saved in the RAM 203. If the image contains a natural scene or graphic, 
processing for natural-scene portion or graphic portion is continued. If the image does not contain a natural scene or 
graphic, the program branches to step S2801 so that a transition is made to processing for a natural scene and graphic. 
[0^7] If a natural scene or graphic data is present In the tMjffer, it is determined at step S2802 whether a compres- 
sion command for this data has entered ham tiie host computer. It should be noted that the compression command 

55 enters, togettier with the command indicating the type of PDL, at step S2501 . 

[0288] If compression Is commarxied. the program proceeds to step S2703. Here the image data of each area is 
compressed and coded by each designated compression metiiod. For example. ADCT processing is used in case of a 
natural scene, and MMR processing Is used in case of a graphic. 
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[0289] If compression is completed, the compressed code is re-saved in the RAM 203 together with the position 
information otstained from the area discriminating processing and saved In the RAM 203. If the natural scene or graphic 
is connected to the previous txjffer, then it is saved in a form contiguous with the data in the previous buffer. 
[0290] tf it is determined at step S2702 that there is no compression command, then the image data of the graphic 
5 area and natural-scene area accumulated in the buffer memory 209 is re-saved as is in the RAM 203 together with the 
position information that has been saved in the RAM 203. 

[0291] If the saving of data in the buffer memory 209 ends, it is determined at step S2705 whether the processing 
for the entire image of interest has ended. If processing has ended, then a transition is made to PDL conversion 
processing by step S2801 . If it is determined that processing has not ended, processing of the next band is started. 
10 [0292] If area discrimination and attribute discrimination of the image and coding processing suited to each 
attribute have been concluded, the program proceeds to step S2801 . Here a conversion is made to the designated PDL 
of the kind shown in Fig. 27 and described earlier. The result is stored in the RAM 203 as image data converted to the 
PDL 

[0293] Thus, image data can be converted to PDL 

15 

< Scanner/printer operation > 
[0294] 

[0295] The operation of the scanner/jDrinter server 102 having the above-mentioned PDL converter circuit 227 will 
20 now be described. 

[Scanner] 

(Pre-scanning) 

25 

[0296] 

-> A read-in designation is applied by the client process 1 05 on the side of the host computer. 

-> The designation is received by the server process 1 06 on the side of the scanner/printer server. 
30 An image is read in from the scanner 31 0 of the copier 1 03. 

-> The server 102 buffers the image data, which has been read in, in the buffer memory 209. 

-> Data that has been subjected to thinning-out processing or compression processing is transferred to the host com- 
puter 101 through the network 104. 

-> The client process 105 on the side of the host computer causes a monitor (not shown) to display thinned-out data 
35 or compressed image data that has been decompressed. 

[0297] The Image read in by the copier 103 through the foregoing operation is received by the host computer 101 . 

(2) Character-recognition scanning 

40 

[0298] 

-> The image data ot)tained by the pre-scanning (1) undergoes character-area designation and reading in of the 
image from the client process 105 is designated again. 
45 Reading in is designated by the server process 1 08 on tiie side of tiie scanner/jsrinter server. 
The designated area is read in by the scanner 310 of the copier 1 03. 
-> The server 102 buffers the read image data in the buffer memory 209. 
-> The character areas of the buffered image data are subjected to character segmentation. 
-> Character coding is perfonned by tine character recognition circuit 210. 
50 ~> The character codes are accumulated in tiie RAM 203. 

The character codes are transferred to the host computer 1 01 through the network 1 04. 

[0299] By performing the foregoing operation, an image is read in by the copier 1 03, characters are recognized and 
the results are received by the host 101 . 
55 [0300] The processing described below can be added to the character-recognition scanning operation set forth 
above. 

O When characters are segmented from the buffered image data, character color or background odor is detected. 
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characters of a designated color or of a color other than that designated are recognized, the characters are coded 
and the codes are transferred to the host computer. 

& By segmenting a character from the buffered character image, character position is detected, this is added on 
to the character code and the result is transferred to the host computer 101 . 

By segmenting a character from the txiffered character image, character position is detected, the character 
code and position information obtained are converted into the form of page description language and the result is 
transferred to the host computer 101 . 

The type of font and the size of character code resulting from character recognition are detected, after which 
the type of font and size are changed by a designation made in advance from the host computer 1 01 . 
10 ® The character image read in is held in the server 102 in the form of page description language, tNs is combined 
with innage data (a natural scene or the like) obtained by scanning the image data again and the result is transferred 
to the host computer 101 . 

© The character image read in is held in the server 102 in the form of page description language, this is combined 
with image data, which is obtained by scanning the image data again, after this image data is compressed, and tiie 

IS result is transferred to the host computer 101. 

The items of character image data, graphic data and image data are converted into page description language 
and the result is transferred to the host computer 101 together with the character data. With regard to the process- 
ing performed by tiie PDL converter, designation of a character area, graphic area or an area that is an image area 
is unnecessary, as already described. The areas of each of ttiese image types are discriminated by tiie area dis- 

20 criminating procedure in the manner set forth above. Also in a case where only characters are recognized, charac- 
ter areas can be recognized and therefore area designation need not be made from the host. 

[0301 ] The foregoing operations also can be performed. In a case where the printer of tiie copier 103 is used, or in 
a case where the server 102 is used as a character-recognition/teletext communication server, the server 102 operates 
25 in the same manner as the first embodiment. 

< Packet configuration (Fig. 21 A and 21 B)) 

[0302] The addition of the PDL converter circuit is accompanied by addition of a new f ield to tiie configuration of the 

30 pre-scanning packet shown in Fig. 16A arKi scanning packet shown in Fig. 16B. 

[0303] Fig. 21 A illustrates the configuration of pre-scanning packet, and Fig. 21 B shows the configuration of a scan- 
ning packet. TTie PDL field is added to the pre-scanning packet and scanning packet. The fields other than the added 
PDL field are the same as those of the first emtxxliment. The other packets are the same as those of the first embodi- 
ment. Accordingly, only the PDL field will be described. 

35 [0304] The PDL field is a field for setting data which determines whetiier a conversion to PDL is to be designated 
with regard to the scanned data. The data is set to "0" when a PDL conversion is not carried out In a case where PDL 
conversion is performed, a value predetermined for each type of PDL is set. for example. "1" is set if CaPSL is used as 
the PDL and "2" is set if PostScript is used as the PDL 

[0305] Using this packet, the host computer 101 executes the message-exchange procedure illustrated in Rg. 13. 
40 thereby instructing the server 102 of the PDL conversion of the image data. 

[0306] If a copier that is consti-ucted arKi functions in the atxTve-described manner and its server system are used, 
the following effects are obtained: 

(1) The copier can be combined with a scanner/printer server, which is capable of performing character recognition. 
45 and can be used as a common resource in a network. In other words, the network user is capable of sharing the 

server function as well as the copier. 

(2) A character-image original is read from the scanner and a character code is obtained. As a result, the amount 
of data is reduced and the load upon the network diminished, thereby raising the processing speed of the computer 
and improving operability. 

50 (3) The character-image original read in by the scanner can be converted into page description language automat- 
ically. 

(4) A colored character-image original can be read in and characters of a designated color can be extracted from 
the original. 

(5) The type and size of characters in the character-image original that has been read in can be changed and then 
55 printed. 

(6) TTie character-innage that has been read in can be subjected to character recognition, converted into character 
codes arxJ tBnslated automatically. 

(7) The host connputer in tiie network is capable of utilizing only the character recognition function of the server. 
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(8) A character-image original is subjected to character recognition and can either be sent to a public switched tel- 
ephone network or received as a character code and then printed. 

(9) An image read in by the scanner is converted into PDL. thereby mal^ng It possible to reduce the amount of 
image data. Further, the memory required for the image data can be reduced and the time required for transferring 
the image data can be shortened. 

[0307] As many apparently widely different emtxxiiments of the present invention can be made without departing 
from the scope thereof, it is to be understood that the invention is not limited to tiie specific en^t)odiments thereof except 
as defined in the appended claims. 

Claims 

1 . An image processing apparatus comprising : 

communication means (219;220) for sending and receiving data via a communication network; and 

control means (201) for controlling said communication means to send the data to said another apparatus, 

characterized by comprising: 

input means (310) for inputting an original image including a character image; 

character image extraction means (210;S2511-S2517) for extracting tiie character image from the original 
image; 

character recognition means (210;S2603) for recognizing the extracted character image and converting the 
character image into a character code in accordance with the result of the recognition; and 
coding means (227:82801) for converting the character code and a position from which the character image is 
extracted into code data, described in a page description language which can be interpreted by anotiier appa- 
ratus connected to said communication networK so that a character image represented by the character code 
is outputted at a position corresponding to the position from which the character image Is extracted. 

2. Apparatus according to claim 1 , wherein said coding means has compressing means for compressing the data cor- 
responding to the input original image. 

3. Apparatus according to daim 1 or daim 2, further comprising: 

pre-input means (310) for pre-inputting the original image prior to inputting by said input means and displaying 

the pre-input innage; and 

designation means for designating areas in which a character image is recognized in the pre-input image; 
wherein said recognition means are adapted to recognize a character image in the area designated by sakJ 
designation means. 

4. Apparatus according to daim 3, wherein sakJ pre-input means tiiins tiie original image and displays tiie tiiinned 
image. 

5. Apparatus according to any one of daims 1 to 4. further comprising: 

translation means (213) for translating sentences which consist of the recognized character codes to target 
sentences which consist of target character codes; 

wherein said control means is adapted to control said communication means to send the translated character 
codes to said other apparatus to which the page description language corresponds. 

6. Apparatus according to any preceding daim, further comprising output means (31 1) for outputting an innage based 
upon the code data. 

7. Apparatus according to claim 6, wherein said input means arxi output means are a scanner and a printer, respec- 
tively. 

8. Apparatus according to any preceding claim, wherein said coding means codes image data received k>y said com- 
munication means. 

9. Apparatus according to daim 8. wherein said coding means codes image data inputted by said input means. 
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10. Apparatus according to any preceding claim, further comprising generating means (21 1) for generating an image 
based upon code data, wherein said generating means generates image data, based upon code data and their 
positions received by said communication means. 

1 1 . Apparatus according to any preceding claim, wherein said coding means converts the recognized character image 
into code data based upon command data received by said communication means. 

1 2. Apparatus according to any preceding claim, wherein said character recognition means is adapted to recognize the 
direction of a character image (S2513), and said coding means is adapted to convert the recognised character 
code, the position from which tiie character image is extracted and the direction of ttie character image into code 
data. 

13. Apparatus according to daim 1 further comprising: 

a printer engine (304) which prints an image based upon the character codes described by the page desaip- 
tion language data received via said communication means. 

14. Apparatus according to any preceding claim further comprising a memory (203) storing ttie code data converted 
by said coding means. 

15. Apparatus according to claim 14, wherein said control means is adapted to control said communication means to 
send the code data stored in said memory. 

16. An image processing mettiod for an apparatus connected to communication network, comprising the steps of: 

inputting to the apparatus data representing an original Image including a character image (S2503). character- 
ized by comprising steps of: 

extracting tiie character image from the original image data (S251 1 -S251 7); 

recognizing extracted character image and converting the character image into a character code (S2603); 
converting the character code and the position from which the character image was extracted into code data, 
described in a page description language which can be interpreted by another apparatus connected to the net- 
worK so tfiat a character image represented by tiie character code is outputted at a position corresponding to 
the position from which the character image is extracted (S2801); and 
sending tiie code data converted at said converting step to said another apparatus. 

17. A method according to claim 1 6, wherein said converting step further conprises converting the character code into 
page description language. 

18. A metiiod according to claim 16 or claim 1 7, wherein, in said converting step, a graphic in the image data is recog* 
nized and converted into page description language. 

19. A method according to claim 1 6 or claim 1 1, wherein, in said converting step, a picture In the image data is recog- 
nized and converted into page desaiption language. 

20. A method according to any one of claims 16 to 19. wherein said converting step further comprises a step of com- 
pressing the image data (S2703). 

21 . A method according to any one of claims 16 to 20. wherein the original image is input by a scanner at said inputting 
step and the image is output by a printer at said outputting step. 

22. A method according to any one of claims 16 to 21 , wherein, in said converting step, image data received in said 
communicating step is converted into code data. 

23. A metiiod according to any one of claims 16 to 21, wherein, In said converting step, image data inputted in said 
inputting step is converted Into code data. 

24. A method according to any one of claims 16 to 23. further comprising a generating step of generating image data 
t)ased upon the code data received via tiie communication networK and the generated image is output at said out- 



29 



EP0 564 201 B1 



putting step. 

25. A method acx:ording to any one of claims 16 to 24, wherein, in said converting step, the image data is converted on 
• the basis of command data received via the communication network. 

26. A method according to claim 25. wherein, in said generating step^ the image data is generated on the basis of com- 
mand data received via the communication network 

27. A method according to any of daims 16 to 26, further comprising: 

a pre-inputting step of inputting the original image prior to inputting in said input step and displaying the pre- 
input image; and 

a designating step of designating areas in which a character image is recognized in the pre-input image; 
wherein, in said recognizing step, a character image in the area designated in said designating step is recog- 
nized. 

28. A method according to daim 27, wherein, in said pre-inputting step, the original image is thinned and displayed. 

29. A method according to any one of dainrts 1 6 to 28. further comprising: 

a translating step of translating sentences which consist of the recognized character codes to target sentences 
which consist of target character codes; 

wherein, in said sending step, the translated character codes are sent to the other apparatus to which the page 
description language corresponds. 

PatentansprQche 

1. Bildverarbeitungsvorrichtung, umfassend: 

eine Kbmmunikationseinrichtung (219; 220) zum Senden und Empfangen von Daten Qber ein Kbmmunikati- 
onsnetzwerk; und 

eine Steuereinrichtung (201) zum Steuern der Kommunikationseinrichtung zum Senden der Daten an die 
andere Vorrichtung, gekennzeichnet durch: 

eine Eingabeeinrichtung (310) zum Zufuhren eines ein Zeichenbild beinhaltenden Originalbilds; 

eine Zeichenextraktionseinrichtung (210: S251 1 - S251 7) zum Extrahieren des ZelchentMlds aus dem Original- 

bild: 

eine Zeichenerkennungseinrichtung (210; S2603) zum Erkennen des extrahierten Zeichenbilds und Umwan- 
deln des Zeichenbilds in einen Zeichenkode in Ubereinstimmung mit dem Ergebnis der Erkennung; und 
eine Kbdiereinrichtung (227; S2801) zum Umwandein des Zeichenkodes und einer Position, aus der das Zei- 
chenbild extrahiert wird, in Kodedaten, die in einer Seitenbeschreibungssprache beschrieben sind. we! die 
durch eine andere mit dem Kommunikationsnetzwerk verbundene Vorrichtung interpretiert werden kann, so 
daB ein durch den Zeichenkode reprdsentiertes Zeichenbild an einer Position entsprechend der Position, aus 
der das Zeichenbild extrahiert wird, ausgegeben wird. 

2. Vorrichtung nach Anspruch 1 , bei der die Kodiereinrichtung eine Kompressionseinrichtung hat zum Kbmprimieren 
der Daten entsprechend dem zugefOhrten Originalbiid. 

3. Vorrichtung nach Anspruch 1 oder 2. ferner umfassend: 

eine Vorzufuhreinrichtung (310) zum Vorzufuhren des Originalbilds vor dem ZufOhren durch die Eingabeein- 
richtung und Anzeigen des vorzugefuhrten Bilds; und 

eine Angabeeinrichtung zum Angeben von Bereichen, in welchen ein Zeichen in dem vorzugefuhrten Biki 
erkanrtt wird; 

wobei die Erkennungseinrichtung zum Erkennen eines Zeichenbilds in dem durch die Angabeeinrichtung 
angegebenen Bereich ausgelegt ist. 

4. Vorrichtung nach Anspruch 3, bei der die Vorzufuhreinrichtung das Originalbiid ausdOnnt und das ausgedOnnte 
Bild anzeigt 
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5. Vorrichtung nach einem der AnsprQche 1 bis 4, ferner umfassend: 

eine Obersetzungseinrichtung (213) zum Ubersetzen von Sdtzen, welche aus den erkannten Zeichenkodes 
bestehen, in Zielsdtze, welche aus Zielzeichenkodes bestehen; 

wobei die Steuereinrichtung zum Steuern der KommuniKationseinrichtung zum Senden der Obersetzten Zei- 
chenkodes an die andere Von'ichtung. der die Seltenbeschreibungssprache entspricht, ausgelegt ist 

6. Vorrichtung nach einem der vorangehenden AnsprQche, ferner umtessend eine Ausgabeeinrichtung (311) zum 
Ausgeben eines Bilds auf der Grundlage der Kbdedaten. 

7. Vorrichtung nach Anspruch 6. bei der die Eingabeeinrichtung und die Ausgabeeinrichtung ein Scanner bzw. ein 
Drucker sind. 

8. Vorrichtung nach einem der vorangehenden AnsprQche, bei der die Kodiereinrichtung durch die Kommunikations- 
einrichtung empfangene BIkidaten kodiert 

9. Vorrichtung nach Anspruch 8, bei der die Kodiereinrichtung durch die Eingabeeinrichtung zugefuhrte Biteldaten 
kodiert 

10. Vorrichtung nach einem der vorangehenden AnsprQche, ferner umfassend eine Erzeugungseinrichtung (21 1) zum 
Erzeugen eines Bikis auf der Gruixltage von Kodedaten. wobel die Erzeugungseinrichtung Bilddaten auf der 
Grundlage von Codedaten und deren Positionen, die durch die Kbmmunikationseinrichtung emp^gen wurden. 
erzeugt. 

11. Vorrichtung nach einem der vorangehenden AnsprQche. bei der die Kodiereinrichtung das erkannte ZeichenbiU 
auf der Grurxilage von durch die Kbmmunikationseinrichtung empfangenen Befehlsdaten in Kbdedaten konvertiert. 

12. Vonrichtung nach einem der vorangehenden AnsprQche. bei der die Zeichenerkennungseinrichtung zum Erkennen 
der Richtung eines Zeichenbilds (S2513) ausgelegt ist, und die Kodiereinrichtung zum Umwandein des erkannten 
Zeichenkodes, der Position, aus der das Zeichenbild extrahiert wind, und der Richtung des Zeichenbilds in Kbde- 
daten ausgelegt ist. 

13. Vorrichtung nach Anspruch 1 , ferner umfassend: 

ein Druckwerk (304), welches ein BtM auf der Grundlage der Zeichenkodes, beschriek>en durch die Seltenbe- 
schreibungssprache. empfeingen Qber die Kbmmunikatk>n5einrichtung, druckt. 

14. Vorrichtung nach einem der vorangehenden AnsprQche. ferner umfassend einen Speicher (203), der die durch die 
Kodiereinrichtung umgewandelten Kodedaten speichert 

15. Vorrichtung nach Anspruch 14. bei der die Steuereinrichtung zum Steuern der Kbmmunikationseinrichtung zum 
Senden der in dem Speicher gespeicherten Kodedaten ausgelegt ist. 

16. Bildverariseitungsverfahren fur eine mit einem Kommunikationsnetzwerk verbundene Vonrichtung, umfassend die 
Schritte des: 

Zufuhrens von ein ein Zeichenbild beinhaltendes Originaibiki reprdsentierenden Daten zu der Vorrichtung 
(S2503), 

gekennzeichnet durch die Schritte des 

Extrahierens des Zeichenbikls aus den Originalbilddaten (S251 1 - S2517): 

Erkennens des extrahierten Zeichenbilds und Umwandeins des Zeichenbilds in einen Zeichenkode (82603); 
Umwandeins des Zeichenkodes und der Position, aus der das ZeichenbikJ extrahiert wurde, in Kodedaten, die 
in einer Sertenbeschreibungssprache beschrieben sind. welche durch eine andere mit dem Kommunikations- 
netzwerk vertsundene Vorrichtung interpretiert werden kann. so daB ein durch den Zeichenkode reprdsentier- 
tes Zeichenbild an einer Position entsprechend der Position, aus der das Zetchenblid extrahiert wird, 
ausgegeben wird (S2801): und 

Sendens der in dem Umwandlungsschritt umgewarxlelten Kbdedaten an die andere Vorrichtung. 
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17. Verfahren nach Anspruch 16, bei dem der Umwandlungsschritt femer das Umwandein des Zeichenkodes in Sei- 
tenbeschreibungssprache umfa3t 

18. Verfahren nach Anspruch 16 Oder Anspruch 17, bei dem in dem Umwandlungsschritt eine Grafik in den Bilddaten 
erkannt und in Seitenbeschreibungssprache umgewandelt wird. 

19. Verfahren nach Anspruch 16 Oder Anspruch 17. bei dem in dem Umwandlungsschritt ein Bild in den Bilddaten 
erkannt und in Seitenbeschreibungssprache umgewandelt wird. 

20. Verfahren nach einem der AnsprOche 16 bis 19, bei dem der Umwandlungsschritt femer einen Schritt des Kompri- 
mierens der Bilddaten (S2703) umteSt. 

21 . Verfahren nach einem der Anspruche 16 bis 20, bei dem das Originalbild in dem Eingabeschritt durch einen Scan- 
ner zugefuhrt wird und das Bild in dem Ausgabeschritt durch einen Drucker ausgegeben wird. 

22. Verfahren nach einem der AnsprOche 16 bis 21, bei dem in dem Umwandlungsschritt in dem Kommunikations- 
schritt empfangene Bilddaten in Kbdedaten umgewandelt werden. 

23. Verfahren nach einem der AnsprOche 16 bis 21 , bei dem in dem Eingabeschritt zugefOhrte Bilddaten In Kodedaten 
umgewandelt werden. 

24. Verfahren nach einem der Anspruche 16 bis 23. ferner umfassend einen Erzeugungsschritt zum Erzeugen von 
Bilddaten auf der Qrundlage der uber das Kommunikationsnetzwerk empfangenen Kodedaten, wobei das erzeugte 
Bild in dem Ausgat>eschritt ausgegeben wird. 

25. Verfahren nach einem der AnsprOche 16 bis 24, bei dem in dem Umwandlungsschritt die Bilddaten auf der Qrund- 
lage von Qber das Kommunikationsnetzwerk empfangenen Befehlsdaten umgewandelt werden. 

26. Verfahren nach Anspruch 25. bei dem in dem Erzeugungsschritt die Bilddaten auf der C^ndlage von Ober das 
Kommunikationsnetzwerk empfangenen Befehlsdaten erzeugt werden. 

27. Verfahren nach einem der Schritte 16 bis 26, ferner umfassend: 

einen Vorzufuhrschritt zum Zufuhren des Originafbitds vor der Zufuhr in dem Eingabeschritt und Anzeigen des 
vorzugefuhrten Bilds: und 

einen Angabeschritt zum Anget^en von Bereichen. in welchen ein Zeichenbild in dem vorzugefQhrten BiM 
erkannt wird; 

wobei in dem Erkennungsschritt ein Zeichenbitel in dem in dem Angabeschritt angegebenen Bereich erkannt 
wird. 

28. Verfahren nach Anspruch 27. bei dem in dem Vorzufuhrschritt das Originalbild ausgedOnnt und angezeigt wird. 

29. Verfahren nach einem der Anspruche 16 bis 28. ferner umfassend: 

einen Ubersetzungsschritt zum Ubersetzen von Satzen, welche aus den erkannten Zeichenkodes bestehen, 
in Zielsatze. welche aus Zielzeichenkodes bestehen; 

wobei in dem Sendeschritt die ubersetzten Zeichenkodes an die arxdiere Vorrichtung. der die Seitenbeschrei- 
bungssprache entspricht. gesendet werden. 

Revendications 

1 . Dispositif de trartement d'image comprenant : 

un moyen (219 ; 220) de transmission destine k envoyer et k recevoir des donn^es par Tinterm^diaire d'un 
r^eau de transmission ; et 

un moyen (201) de commande destine k commander ledit moyen de transmission pour envoyer les donn^es 
audit autre cfispositif, caract6ris6 en ce qu'il comprend : 

un moyen (310) d*entr6e destin6 k entrer une image d'original induant une image de caract^es ; 
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un moyen (210 ; S2511 k S2517) d'extraction dlmage de caractdres destind k extraire I'image de caractdres 
de rimage d'originai ; 

un moyen (210 ; S2603) de reconnaissance de caract^es destine d reconnaltre Timage de caract^res extraite 
el k convertir I'inrtage de caract^res en un code de caract^res, en fonction du r^sultat de la reconnaissance ; et 
5 un moyen (227 ; S280 1 ) de codage destin6 ^ convertir le code de caract^res et une position d partir de laquelle 

on a extrait Umage de caract^res en donn^es de code, d^rites dans un langage de description de page qui 
peut §tre interpr6t6 par un autre disposittf connects audit r^seau de transmission, de fagon k sortir une image 
de caract^res representee par le code de caract^res k une position correspondant k la position d'ou est 
extraite I'image de caract^res. 

10 * 

2. Dispositif selon la revendication 1 , dans lequel ledit moyen de codage comporte un moyen de compression destine 
k comprimer les donn^es correspondant k I'image d'originai errtr6e. 

3. Dispositif selon la revendication 1 ou la revendication 2. comprenant en outre : 

15 

un moyen (310) de preentree destine k preentrer I'image d'originai avant I'entree par ledit moyen d'entree et k 
afficher Umage preentree ; et 

un moyen de designation destine k designer des zones dans lesquelles on reconnatt une image de caracteres 
dans I'image preentree ; 

20 dans lequel ledit moyen de reconnaissance est apte k reconnaltre une image de caracteres dans la zone desi- 

gnee par ledit moyen de designation. 

4. Dispositif selon la revendication 3. dans lequel ledit moyen de preentree edaircit I'image d'originai et aff iche Timage 
edairde. 

25 

5. Dispositif selon I'une quelconque des revendications 1^4, comprenant en outa-e : 

un moyen (213) de traduction destine k traduire des phrases, qui sont constituees des codes de caracteres 
reconnus, en phrases dbles, qui sont constituees de codes de caracteres cik>les ; 
30 dans lequel ledit moyen de commande est apte k commander ledit moyen de transmission pour envoyer les 

codes de caracteres traduits audit autre dispositif auquel correspond le langage de description de page. 

6. Dispositif selon I'une quelconque des res/endications precedentes, comprenant en outre un moyen (31 1) de sortie 
destine k sortir une image en se basant sur les donnees de code. 

35 

7. Dispositif selon la revendication 6, dans lequel ledit moyen d*entree et ledit moyen de sortie sont, respectivement. 
un numeriseur et une imprimante. 

8. Dispositif selon l*une quelconque des revendications precedentes, dans lequel ledit moyen de codage code des 
40 donnees d'image regues par ledit moyen de transmission. 

9. Dispositif selon la revendication 8. dans lequel ledit moyen de codage code des donnees d'image entrees par ledit 
moyen d'entree. 

45 10. Dispositif selon I'une quelconque des revendications precedentes, comprenant en outre un moyen generateur 
(21 1) destine k engendrer une image en se basant sur les donnees de code, dans lequel ledit moyen generateur 
engendre des donnees dlmage, en se basant sur les donnees de code et sur leurs positions regues par ledit 
moyen de transmission. 

50 11. Dispositif selon i'une quelconque des revendications precedentes, dans lequel ledit moyen de codage convertit 
I'inrtage de caracteres reconnue en donnees de code en se t>asant sur des donnees dinstruction regues par ledit 
moyen de transmission. 

12. Dispositif selon I'une quelconque des revendications precedentes, dans lequel ledit moyen de reconnaissance de 
55 caracteres est apte k reconnaltre la direction d'une image (S2513) de caracteres. et dans lequel ledit moyen de 
codage est apte k convertir. en donnees de code, le code de caracteres reconnu, la position k partir de laquelle est 
extraite I'image de caracteres et la direction de (Image de caracteres. 
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13. Dispositif selon la revendication 1, comprenant en outre : 

un m^canisme (304) d'impression qui imprime une image bas^e sur les codes de caract^res d^crits par les 
donndes de langage de description de page regues par rinterm^dialre dudit moyen de transmission. 

5 

1 4. Dispositif selon Tune quelconque des revendications pr^^entes. comprenant en outre une m^moire (203) m6mo- 
risant les donn^es de code converties par ledit moyen de codage. 

15. Dispositiff selon la revendication 14, dans lequel ledit moyen de commande est apte k commander ledit moyen de 
10 transmission pour envoyer les donn^es de code m6moris6es dans ladite m^moire. 

16. Proc^6 de traitement d'image pour un dispositif connects k un r^seau de transmission, comprenant les ^apes : 

d'entr^. dans le dispositif, de donn^es repr^entant une image d'original incluant une image (S2503) de 
1$ caractdres. caract6ris6 en ce qu'il comprend les 6tapes : 

d'extraction de I'image de caract^res k partir des donn^es d'image d'original (S251 1 k S251 7) ; 

de reconnaissance de I'image de caract^res extraite et de conversion de tlmage de caractdres en un code de 

caract^res (S2603) ; 

de conversion du code de caractdres et de la position d*ou Tlmage de caract^res a ^td extraite, en donn^es de 
20 code, d^ites dans un langage de description de page qui peut §tre interpr^4 par un autre appareil connects 

au r6seau, de fagon k entrer une image de caract^res repr^ent^e par le code de caract^res ci une position 
correspondant k la position d'ou est extraite I'image de caract^res (S2801) ; et 
d'envoi des donn^es de code, converties k ladite ^ape de conversion, audit autre dispositif. 

25 17. Proc^6 selon la revendication 16, dans lequel ladite 6tape de conversion comprend en outre la conversion du 
code de caract^res en un langage de description de page. 

18. Proc^6 selon la revendication 16 ou la revendication 17, dans lequel, dans ladite 6tape de conversion, un gra- 
phisme dans les donn^es damage est reconnu et convert! dans le langage de description de page. 

30 

19. Proc6d6 selon la revendication 16 ou la revendication 17. dans lequel, dans ladite 6tape de conversion, une vue 
dans les donn^ d'image est reconnue et cortvertie dans ledrt langage de description de page. 

20. Proc^6 selon Tune quelconque des revendications 16^19, dans lequel ladite ^ape de conversion comprend en 
35 outre une dtape de compression des donn6es d'image (S2703). 

21 . Proc^6 selon Tune quelconque des revendications 1 6 ^ 20, dans lequel Uncage d'original est entree par un num^ 
riseur, k ladite 6tape d'entr^e. et dans lequel I'image est sortie par une imprimante, k ladite 6tape de sortie. 

40 22. Proc6d6 selon Tune quelconque des revendications 16 ^ 21, dans lequel. dans ladite §tape de conversion, des 
donn6es d'image regues dans ladite 6tape de transmission sont converties en donn6es de code. 

23. Proc6d6 selon I'une quelconque des revendications 16 d 21, dans lequel, dans ladite 6tape de conversion, des 
donn§es d'image errtr^s dans ladite dtape d'entr6e sont converties en donn^es de code. 

45 

24. Proc^k selon Tune quelconque des revendications 16 ^ 23, comprenant en outre une ^tape de production de dorv 
nkes d'image bashes sur les donn^es de code regues par rinterm6diaire du r^eau de transmission, et dans lequel 
I'image engendr^e est sortie k ladite ^tape de sortie. 

50 25. Proc^6 selon I'une quelconque des revendications 16 ^ 24. dans lequel, dans ladite 6tape de conversion, les don- 
n^es d'image sont converties sur la base de donnSes dinstruction regues par I'interm^iaire dudit r^eau de trans- 
mission. 

26. Proc6d6 selon la revendication 25, dans lequel, dans ladite ^ape de production, les donn^es d'image sont produi- 
55 tes sur la base de donn^es d'instruction regues par llnterm^diaire du r6seau de transmission. 

27. Proc^6 selon Tune quelconque des revencfications 16 d 26, comprenant en outre : 
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une 6tape de prdentr^e pour entrer llmage d*original avant Tentr^e dans ladite 6tape d'entr6e et pour afFicher 
rimage pr6entr6e ; et 

une 6tape de designation pour designer des zones dans lesquelles une image de caract^res est recx)nnue 
dans rimage pr6entr6e ; 

5 dans lequel. dans ladite 6tape de reconnaissance, on reconnatt une image de caract^res dans la zone d6si- 

gn6e dans ladrte 6tape de dte'gnation. 

28. Proc^6 selon la revendication 27, dans lequel dans ladite 6tape de pr^entr^, on 6daircit I'image d'original et on 
I'afflche. 

10 

29. Proc6d6 selon I'une quelconque des revendications 16 d 28, comprenant en outre : 

une etape de traduction pour traduire des phrases, qui sont constitutes des codes de caract^res reconnus, en 
phrases cibles, qui sont constitutes de codes de caracttres cibles ; 
15 dans lequel, dans ladite ttape d'envoi, les codes de caracttres traduHs sont envoyts k Tautre dispositif auquel 

correspond le langage de description de page. 
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